JP2007267218A - Sound volume monitoring device, communication terminal device, communication system, communication method, echo canceller, and computer-readable program for functioning echo canceller - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To confirm an operation of a loudspeaker or confirm an operation of the loudspeaker and a microphone by a remote control. <P>SOLUTION: A TV telephone terminal device receives a level of a dummy echo signal on a communication mating side and confirms the operation of the loudspeaker and microphone on the communication mating side based on the level of the dummy echo signal. The dummy echo signal indicates a speech turning from the loudspeaker to the microphone on the communication mating side and is not affected by a surrounding noise, etc. on the communication mating side. For this reason, the operation of the loudspeaker and microphone on the communication mating side can be reliably confirmed. <P>COPYRIGHT: (C)2008,JPO&amp;INPIT

Description

  The present invention relates to a volume monitoring device, a communication terminal device, a communication system, a communication method, an echo canceller, and a computer readable functioning echo echo canceller capable of remotely confirming the operation of a speaker or the operation of a speaker and a microphone. Related to various programs.

  Even if an audio signal is sent to the speaker, it may be difficult to confirm the output from the speaker. For example, in premises broadcasting, while broadcasting a sound signal from a broadcast room to a speaker in another room, the broadcast room is broadcasting without confirming whether the sound is being output from the speaker in the other room. . Also, in videophone communication and the like, when audio is input to the microphone of the first terminal device, an audio signal is transmitted / received from the first terminal device to the second terminal device through the line network, added to the speaker, and the audio is transmitted. Although it is output from the speaker, it cannot be confirmed on the first terminal device side whether sound is output from the speaker of the second terminal device.

  For this reason, in videophone communication, even if you are looking at each other's images, before you start a conversation, make a voice call like “Hello” on both sides so that the voice can communicate with each other. In some situations, this confirmation was repeated several times.

  In Patent Document 1, when audio data is transmitted and received from the first terminal device to the second terminal device and the audio is output from the speaker, the audio is input to the microphone and detected, and the volume of the audio is detected. Is transmitted from the second terminal device to the first terminal device, so that the sound volume of the second terminal device can be known on the first terminal device side.

Also, in Patent Document 2, the control device sends a reference audio signal to the terminal device, outputs the audio from a speaker, inputs the audio to a microphone, and the detection level of the echo canceler processed audio signal at this time is a predetermined level. When the reference value is exceeded, an abnormality of the terminal device with an abnormally large echo back amount is detected.
JP 2004-48329 A Japanese Patent Laid-Open No. 10-200509

  However, when the sound is simply input to the microphone and detected as in Patent Document 1, ambient noise or the like may be input to the microphone, resulting in erroneous detection of the sound. Therefore, it is impossible to reliably know whether sound is output from the speaker.

  Further, in Patent Document 2, only the abnormality of a terminal device (including an echo canceller) is detected, and if the terminal device is operating correctly, the detection level is substantially 0, and the terminal device speaker is used. It is not possible to know whether the sound is output at an appropriate level.

  Accordingly, the present invention has been made in view of the above-described conventional problems, and a volume monitoring device, a communication terminal device, and a communication system capable of remotely confirming the operation of a speaker or confirming the operation of a speaker and a microphone. An object of the present invention is to provide a communication method, an echo canceller, and a computer-readable program that allows the echo canceller to function.

  In order to solve the above problems, a volume monitoring device of the present invention inputs at least a speaker and a microphone, and an audio signal applied to the speaker, measures an echo level of the sound from the speaker to the microphone, and Echo level measuring means for outputting an echo level.

  Also provided is an informing means for inputting the echo level output from the echo level measuring means and informing the echo level.

  The communication terminal device according to the present invention is a communication terminal device that performs communication through a line network. At least a speaker and a microphone used for a call and an audio signal applied to the speaker are input to the communication terminal device from the speaker to the microphone. Echo level measurement means for obtaining an echo level of the voice and outputting the echo level; and transmission means for transmitting the echo level output from the echo level measurement means to the communication partner.

  Furthermore, it comprises audio level detection means for detecting the level of an audio signal received from the communication partner and applied to the speaker, and the transmission means sets the level of the audio signal detected by the audio level detection means to the echo level. Sending with.

  Further, the communication terminal device of the present invention is a communication terminal device that communicates through a line network, and receives an echo level or a voice signal level from a communication partner and notifies the echo level or the voice signal level. The echo level is an echo level of sound from a speaker to a microphone in the communication partner, and the level of the sound signal is a level of a sound signal received by the communication partner and applied to the speaker. is there.

  Furthermore, remote control means for remotely controlling the communication partner and adjusting the output level of the speaker or the input sensitivity of the microphone at the communication partner is provided.

  The communication system of the present invention is a communication system in which communication is performed between a first terminal device and a second terminal device through a circuit network. The first terminal device is a speaker and a microphone used for a call with the second terminal device. And an echo level measuring means for inputting at least an audio signal applied to the speaker, obtaining an echo level of the voice from the speaker to the microphone, and outputting the echo level, the echo level measuring means Is transmitted to the second terminal device, and the second terminal device includes notification means for receiving the echo level and notifying the echo level.

  The communication method of the present invention is a communication method in which mutual communication is performed between the first and second terminal devices through a circuit network. The first terminal device uses a speaker and a microphone used for a call with the second terminal device. And obtaining an echo level of the sound from the speaker to the microphone, and transmitting the echo level to the second terminal device. The second terminal device receives the echo level and receives the echo level. We are reporting.

  Further, the echo canceller of the present invention receives at least an audio signal applied to a speaker, obtains an echo level of sound from the speaker to the microphone, and a pseudo echo of the echo level obtained by the measuring means Adding means for forming a signal and adding the pseudo echo signal to the audio signal output from the microphone, and the measuring means has output means for outputting the echo level.

  Furthermore, the computer-readable program for causing the echo canceller of the present invention to function includes a measurement step of inputting at least an audio signal applied to a speaker and measuring an echo level of the audio from the speaker to the microphone, and the measurement step Forming a pseudo echo signal of the echo level determined in step 1, and adding the pseudo echo signal to the audio signal output from the microphone; and an output step of outputting the echo level determined in the measurement step; Is included.

  In the sound volume monitoring apparatus of the present invention, the echo level of the sound from the speaker to the microphone is measured, and this echo level is output. When no sound is output from the speaker or when the sound of the speaker is not input to the microphone, the echo level becomes substantially 0, and when the output level of the sound of the speaker and the input level of the sound of the microphone are increased, The echo level increases. Therefore, the operation of the speaker and microphone can be confirmed based on the echo level.

  Even if ambient noise or the like enters the microphone, the echo level does not increase, so that the operation of the speaker and the microphone is not erroneously confirmed.

  Furthermore, since the echo level is notified, the operation of the speaker and the microphone can be confirmed by knowing the notified echo level.

  In addition, the communication terminal device of the present invention has a speaker and a microphone used for a call, measures the echo level of sound from the speaker to the microphone, and transmits this echo level to the communication partner. Therefore, the communication partner can check the operation of the speaker and the microphone based on this echo level.

  Further, the level of the audio signal received from the communication partner and applied to the speaker is detected, and the detected level of the audio signal is transmitted together with the echo level. For this reason, the communication partner can know the level of the audio signal applied to the speaker and can confirm the operation of the speaker and the microphone.

  In the communication terminal device of the present invention, the echo level or the level of the audio signal is received from the communication partner and the echo level or the level of the audio signal is notified. For this reason, the communication terminal apparatus can confirm the operation of the speaker and microphone of the communication partner or know the level of the audio signal of the communication partner.

  Further, the communication partner is remotely controlled to adjust the speaker output level or the microphone input sensitivity at the communication partner. For example, when the echo level is low, the speaker output level or the microphone input sensitivity is optimized by increasing the speaker output setting or increasing the microphone input sensitivity.

  On the other hand, also in the communication system or the communication method of the present invention, the same operation and effect as those of the communication terminal apparatus of the present invention can be achieved.

  In the echo canceller and the computer readable program for operating the echo canceller of the present invention, at least an audio signal applied to the speaker is input, and an echo level of the audio from the speaker to the microphone is measured and output. Therefore, the operation of the speaker and microphone can be confirmed based on this echo level.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a block diagram showing an embodiment of a communication system of the present invention. In the communication system of the present embodiment, two TV phone terminal apparatuses 1-1 and 1-2 are interconnected through the Internet, and TV phone communication is performed between these TV phone terminal apparatuses 1-1 and 1-2.

  In FIG. 1, only two TV phone terminal devices 1-1 and 1-2 are shown. These TV phone terminal devices 1-1 and 1-2 include a number of TV phone terminal devices. Of the two interconnected.

  Each TV phone terminal device 1-1, 1-2 has the same configuration, an Internet communication unit 2 that performs packet communication through the Internet IN, a buffer memory 3 that temporarily stores received packets, and the entire TV phone terminal device. A control unit 4 that controls the user, an input operation unit 5 that is operated by a user, an image decoding unit 6 that decodes image data received through the Internet IN and outputs a video signal, a display unit 7 that displays an image, and a video signal A display control unit 8 for displaying the image indicated by the display unit 7, a video camera 9 for photographing a user, an image encoding unit 11 for encoding a video signal output from the video camera 9 and outputting image data, A voice decoding unit 12 that decodes voice data received through the Internet IN and outputs a voice signal, and adjusts the level of the voice signal Speaker volume adjusting unit 13 for outputting, speaker 14 for inputting sound signal and outputting sound, microphone 15 for inputting user's sound, microphone sensitivity adjusting unit for adjusting and outputting the level of sound signal input from microphone 15 16, an audio encoding unit 17 that encodes an audio signal from the microphone 15 and outputs audio data, and an echo canceller 18 for canceling an echo component between the speaker 14 and the microphone 15 are provided.

  Here, the TV telephone terminal apparatuses 1-1 and 1-2 are connected to each other by an outgoing call and an incoming call through the Internet IN, and are in a state where they can mutually communicate images and voices.

  In the TV phone terminal device 1-1, a user is photographed by the video camera 9, and a video signal indicating the user's image is transmitted and received from the video camera 9 to the image encoding unit 11. Is converted into image data, a packet including the image data is formed by the control unit 4, and the packet is transmitted from the Internet communication unit 2 to the TV telephone terminal device 1-2 through the Internet IN.

  In the TV phone terminal device 1-2, when a packet including image data is transmitted from the TV phone terminal device 1-1 through the Internet IN, the packet is received by the Internet communication unit 2, and the packet is transmitted to the control unit through the buffer memory 3. 4, image data is extracted from the packet by the control unit 4, this image data is given to the image decoding unit 6, the image data is converted into a video signal by the image decoding unit 6, and the video signal is converted to the display control unit 8. The image of the user of the TV telephone terminal device 1-1 on the communication partner side indicated by the video signal is displayed on the display unit 7 through the display unit 7.

  At the same time, in the TV phone terminal device 1-2, the user of the TV phone terminal device 1-2 on the self side is photographed by the video camera 9, and a video signal indicating the image of the user on the self side is displayed in the image encoding unit 11, The image is added to the display unit 7 through the control unit 4, the image decoding unit 6, and the display control unit 8, and the image of the user on the self side is displayed on the display unit 7.

  For example, as shown in FIG. 2, the image 21 of the user on the communication partner side is displayed large on the screen 7a of the display unit 7, and the image 22 of the user on the self side is displayed small.

  In the TV phone terminal device 1-1, the user's voice is input to the microphone 15, and a voice signal indicating the user's voice is transmitted from the microphone 15 to the voice encoding unit 17 through the microphone sensitivity adjustment unit 16. The voice encoding unit 17 converts the voice signal into voice data, the control unit 4 forms a packet including the voice data, and the packet is transmitted from the Internet communication unit 2 to the TV telephone terminal device 1-2 through the Internet IN. .

  In the TV phone terminal device 1-2, when a packet including voice data is transmitted from the TV phone terminal device 1-1 through the Internet IN, the packet is received by the Internet communication unit 2, and the packet is transmitted through the buffer memory 3 to the control unit. 4, audio data is extracted from the packet by the control unit 4, the audio data is given to the audio decoding unit 12, the audio data is converted into an audio signal by the audio decoding unit 12, and the audio signal is converted into a speaker volume adjustment unit 13 is added to the speaker 14, and the voice of the user of the TV telephone terminal device 1-1 on the communication partner side is output from the speaker 14.

  Similarly, a user is photographed by the video camera 9 of the TV telephone terminal apparatus 1-2, a video signal indicating the user's image is converted into image data, and a packet including the image data is converted into a TV telephone terminal apparatus 1-. 2 to the TV phone terminal device 1-1 through the Internet IN. In the TV phone terminal device 1-1, the image data of the packet is converted into a video signal, and an image of the user of the TV phone terminal device 1-2 on the communication partner side indicated by the video signal is displayed on the display unit 7. At the same time, an image of the user of the self-side TV phone terminal device 1-1 is also displayed on the display unit 7.

  In addition, a user's voice is input to the microphone 15 of the TV phone terminal device 1-2, a voice signal indicating the voice is converted into voice data, and a packet including the voice data is transmitted from the TV phone terminal device 1-2 to the Internet. It is transmitted to the TV phone terminal device 1-1 through IN. In the TV phone terminal device 1-1, the voice data of the packet is converted into an audio signal and added to the speaker 14, and the voice of the user of the TV phone terminal device 1-2 on the communication partner side is output from the speaker 14.

  Therefore, in the TV phone terminal device 1-2, the image of the user of the TV phone terminal device 1-1 and the image of the user on the self side are displayed on the display unit 7, and the use of the TV phone terminal device 1-1 is also used. The user's voice is output from the speaker 14, and in the TV phone terminal device 1-1, the image of the user of the TV phone terminal device 1-2 and the image of the user on the self side are displayed on the display unit 7. The voice of the user of the TV phone terminal device 1-2 is output from the speaker 14. That is, the users of the TV phone terminal apparatuses 1-1 and 1-2 can perform TV phone communication with each other.

  On the other hand, in each of the TV phone terminal apparatuses 1-1 and 1-2, the audio signal output level to the speaker 14 (corresponding to the audio output level of the speaker 14) and the microphone 15 are in the TV phone communication. The input level of the audio signal (corresponding to the input sensitivity of the microphone 15) can be arbitrarily adjusted.

  For example, when the user operates the input operation unit 5 to instruct the control unit 4 to input an arbitrary output level as the sound output level of the speaker 14, the control unit 4 responds to the speaker volume adjustment unit 13. Is controlled to adjust the level of the audio signal input from the speaker volume adjusting unit 13 to the speaker 14 so that the audio of the arbitrary output level is output from the speaker 14.

  Alternatively, when the user operates the input operation unit 5 and instructs the control unit 4 to input any input sensitivity as the input sensitivity of the microphone 15, the control unit 4 controls the microphone sensitivity adjustment unit 16 in response to this. Then, the level of the audio signal input from the microphone 15 to the control unit 4 through the microphone sensitivity adjustment unit 16 is adjusted, and the microphone 15 is set to have an arbitrary input sensitivity.

  In addition, each of the TV phone terminal apparatuses 1-1 and 1-2 performs a hands-free loudspeaking call using the speaker 14 and the microphone 15 arranged at appropriate positions. However, when a hands-free loudspeaking call is performed, there is a possibility that so-called echo or howling may occur due to sound sneaking from the speaker 14 to the microphone 15.

  Therefore, an echo canceller 18 is provided between the speaker 14 and the microphone 15, and the echo canceller 18 cancels the sound that circulates from the speaker 14 to the microphone 15 to prevent echo or howling.

  FIG. 3 is a block diagram showing the configuration of the echo canceller 18. The echo canceller 18 inputs an audio signal to the speaker 14 and an audio signal from the microphone 15 and outputs a pseudo echo signal (negative signal), and a pseudo echo signal output from the arithmetic unit 31. And an adder 32 that receives the audio signal from the microphone 15 and outputs an audio signal composed of a component obtained by subtracting the pseudo echo signal from the audio signal.

  In the echo canceller 18, when an audio signal is input from the speaker volume adjusting unit 13, the audio signal is added to the speaker 14 as it is, and the audio signal is temporarily accumulated by the computing unit 31. The computing unit 31 adjusts the delay time and amplitude according to the acoustic transfer characteristics from the speaker 14 to the microphone 15 for each frequency component of the temporarily accumulated audio signal, and creates a pseudo echo signal from the audio signal. The pseudo echo signal (negative signal) is added to the adder 32. This pseudo echo signal corresponds to the wraparound sound that circulates from the speaker 14 to the microphone 15. When the adder 32 receives the sound signal from the microphone 15, the adder 32 adds the sound signal and the pseudo echo signal (negative signal), and removes the sneak sound from the speaker 14 to the microphone 15 from the sound indicated by the sound signal. Then, an audio signal indicating the difference is output. As a result, the user's voice is input to the microphone 15 in the same state as when there is no voice component that circulates from the speaker 14 to the microphone 15, and echo or howling is prevented.

  The computing unit 31 receives not only the audio signal to the speaker 14 but also the audio signal from the microphone 15, compares both audio signals, and corrects and updates the acoustic transfer characteristics as needed. Thereby, even if the position of the speaker 14 or the microphone 15, the output level of the sound of the speaker 14, the input sensitivity of the microphone 15, and the acoustic characteristics around the speaker 14 or the microphone 15 are changed, the pseudo echo signal is always accurately received. It is possible to effectively prevent echo or howling.

  By the way, in such a TV phone communication, even if you are watching each other's images, if you do not know whether your voice is transmitted to the other party, before entering the conversation, or conversation In the middle of this, it is necessary to confirm that the voices communicate with each other by uttering “Hello” in both directions, which impedes the prompt execution of TV phone communication.

  For this reason, in this embodiment, the level of the pseudo echo signal formed by the computing unit 31 of the echo canceller 18 on the communication partner side, the output level of the audio signal to the speaker 14 on the communication partner side, and the microphone 15 on the self side The voice signal input level or the like can be used to check whether or not his / her voice is transmitted to the communication partner.

  In the TV telephone terminal device 1-1, when the level of the pseudo echo signal is obtained by the arithmetic unit 31 of the echo canceller 18 as described above, the level of the pseudo echo signal is notified from the arithmetic unit 31 to the control unit 4. Is done.

  The level of the pseudo echo signal corresponds to the sound output level of the speaker 14 and the input sensitivity of the microphone 15, and indicates the operating state of the speaker 14 and the microphone 15. For example, when no sound is output from the speaker 14 or when the sound of the speaker 14 is not input to the microphone 15, the level of the pseudo echo signal becomes substantially 0, and the output level of the sound of the speaker 14 and the sound of the microphone 15 When the input level increases, the level of the pseudo echo signal increases. Therefore, the operation of the speaker 14 and the microphone 15 can be confirmed based on this pseudo echo signal.

  Further, the speaker volume adjustment unit 13 obtains the output level of the audio signal to the speaker 14 and notifies the control unit 4 of the output level of the audio signal to the speaker 14.

  When the control unit 4 inputs the level of the pseudo echo signal from the calculator 31 of the echo canceller 18 and also receives the output level of the audio signal to the speaker 14, the control unit 4 outputs the level of the pseudo echo signal and the output of the audio signal to the speaker 14. Control data indicating the level is created, a packet including the control data is formed, and the packet is transmitted from the Internet communication unit 2 to the TV telephone terminal device 1-2 through the Internet IN.

  In the TV phone terminal device 1-2, when a packet including control data is transmitted from the TV phone terminal device 1-1 through the Internet IN, the packet is received by the Internet communication unit 2, and the packet is transmitted through the buffer memory 3 to the control unit. 4, and control data is extracted from the packet by the control unit 4. When the control unit 4 extracts the control data of the TV phone terminal device 1-1, the control unit 4 acquires the level of the pseudo echo signal indicated by the control data and the output level of the audio signal to the speaker 14, and the level of the pseudo echo signal and the audio The input level of the audio signal from the microphone 15 is obtained based on the output level of the signal. Since the level of the pseudo echo signal corresponds to the level of the sneak sound from the speaker 14 to the microphone 15, the audio signal from the microphone 15 is based on the level of the pseudo echo signal and the output level of the audio signal to the speaker 14. Can be obtained.

  When the control unit 4 obtains the output level of the audio signal to the speaker 14 and the input level of the audio signal from the microphone 15 in the TV telephone terminal device 1-1 on the communication partner side, the output level to these speakers 14 is acquired. The input level from the microphone 15 is displayed on the display unit 7 through the display control unit 8.

  In the TV phone terminal device 1-2, the microphone sensitivity adjustment unit 16 obtains the input level of the audio signal from the microphone 15 to the control unit 4, and the input level of the audio signal from the microphone 15 is the microphone sensitivity adjustment unit 16. To the control unit 4. When the input level of the audio signal from the microphone 15 is input, the control unit 4 displays the input level of the audio signal from the microphone 15 in the TV phone terminal device 1-2 on the self side on the display unit 7 through the display control unit 8. .

  Furthermore, the control unit 4 monitors the accumulation time (corresponding to the accumulation amount) of the voice data packets received from the videophone terminal device 1-1 on the communication partner side and temporarily accumulated in the buffer memory 3. The storage time of the voice data packet is displayed on the display unit 7 through the display control unit 8.

  Accordingly, the display unit 7 of the TV phone terminal device 1-2 displays the output level to the speaker 14 (sound output level of the speaker 14) and the input level from the microphone 15 in the TV phone terminal device 1-1 on the communication partner side. (Input sensitivity of the microphone 15) is displayed, and the input level (input sensitivity) from the microphone 15 in the self-side TV phone terminal device 1-1 and the storage time of the voice data packet in the buffer memory 3 are displayed. The

  For example, on the screen 7a of the display unit 7 as shown in FIG. 2, the output level to the speaker 14 and the input level from the microphone 15 in the TV telephone terminal device 1-1 on the communication partner side are indicated by bar graphs 23 and 24, respectively. The bar graphs 25 and 26 display the input level from the microphone 15 and the storage time of the voice data packet in the buffer memory 3 in the TV telephone terminal device on the own side.

  Similarly, in the videophone terminal device 1-2, the level of the pseudo echo signal is obtained by the echo canceller 18, the output level of the audio signal to the speaker 14 is obtained by the speaker volume adjusting unit 13, and the level of the pseudo echo signal and Control data indicating the output level of the audio signal to the speaker 14 is created, and a packet including this control data is transmitted to the TV phone terminal device 1-1.

  When the packet including the control data is received from the TV phone terminal device 1-2 on the communication partner side, the TV phone terminal device 1-1 receives the level of the pseudo echo signal indicated by the control data and the sound to the speaker 14. The input level of the audio signal from the microphone 15 is obtained based on the output level of the signal, and the output level to the speaker 14 and the input level from the microphone 15 are displayed on the display unit 7. Further, the input level of the audio signal from the microphone 15 is obtained by the microphone sensitivity adjustment unit 16 on the self side, and the input level from the microphone 15 is displayed on the display unit 7. Further, the storage time of the voice data packets temporarily stored in the buffer memory 3 is displayed on the display unit 7.

  Here, the user looks at each of the bar graphs 23 to 26 on the screen 7a of the display unit 7 of the self-side TV phone terminal device, and the output level to the speaker 14 and the microphone 15 in the TV phone terminal device on the communication partner side. , The input level from the microphone 15 in the TV telephone terminal device on the own side, and the storage time of the voice data packet in the buffer memory 3 can be confirmed, and thus the TV telephone communication is normally performed. You can know if it is done.

  For example, the user can confirm whether or not the communication is normally performed by confirming whether the accumulation time of the voice data packet is excessive or insufficient. Further, the user can confirm whether or not the input sensitivity of the microphone 15 is appropriately set by checking whether the input level from the microphone 15 in the TV telephone terminal apparatus on the self side is excessive or insufficient. Further, the user confirms whether the output level to the speaker 14 and the input level from the microphone 15 in the TV telephone terminal device on the communication partner side are excessive or insufficient, and the output level of the voice on the communication partner side and the input sensitivity of the microphone 15 are confirmed. It is possible to know whether or not is appropriately set.

  Further, in the TV telephone terminal apparatus, the output level to the speaker 14 on the communication partner side and the level of the pseudo echo signal, the input level from the microphone 15 on the own side, and the accumulation time of the voice data packet in the buffer memory 3 are set. In addition to acquiring and displaying, the output level to the speaker 14 on the self side is acquired. Then, based on the acquired level or the like, it is determined whether or not the TV phone communication is normally performed. If the communication is not normally performed, the display unit provides display support that helps to normalize the communication. 7 on the screen 7a. That is, not only is the bar graphs 23 to 26 displayed on the screen 7a of the display unit 7 displayed, and it is left to the user to determine whether or not the TV phone communication is normally performed, but the TV phone communication is normally performed. It is determined whether the communication is normal or not, and normalization of communication is supported.

  The output level to the speaker 14 on the self side is obtained by the speaker volume adjusting unit 13 and notified to the control unit 4. However, since the user can confirm the volume of the speaker 7, the output level to the speaker 14 is not displayed on the screen 7 a of the display unit 7.

  Next, with reference to the flowchart of FIG. 4, a description will be given of a display and a process for supporting normalization of TV phone communication in the TV phone terminal on the self side.

  First, in the self-side videophone terminal device, the control unit 4 initializes the comment A to be displayed in the column 27 of the screen 7a of the display unit 7 (step S101), and the microphone sensitivity adjustment unit 16 receives the control unit from the microphone 15. The control unit 4 is notified of the input level of the audio signal to the control unit 4. When the input level from the microphone 15 is input, the control unit 4 displays the input level from the microphone 15 on the self side on the display unit 7 through the display control unit 8. Then, the control unit 4 determines whether or not the input level from the microphone 15 is less than 50% of the maximum input level (specified value) from the microphone 15 (step S102). (“Yes” in step S102), “Check microphone volume” is set as the comment A to be displayed (step S103). Further, since the comment A is set (“No” in step S104), the control unit 4 displays the comment A “Please check the microphone volume” set in step S103 through the display control unit 8. 7 is displayed in the column 27 of the screen 7a (step S105).

  Accordingly, when the input level from the microphone 15 on the self side is low, a comment “Please check the microphone volume” is displayed, and the adjustment of the input level from the microphone 15 is prompted.

  If the input level from the microphone 15 is not less than 50% of the maximum input level from the microphone 15 (“No” in step S102), the control unit 4 transmits the audio data packet in the buffer memory 3 on its own side. Is stored for less than 0.1 seconds (step S106), and if it is less than 0.1 seconds (“Yes” in step S106), the comment A to be displayed is “the line is congested” The sound quality may be degraded ”is set (step S107). Furthermore, since the comment A has been set (“No” in step S104), the control unit 4 may have comment A set in step S107 “the line is congested and the sound quality may be degraded. Is displayed in the column 27 of the screen 7a of the display unit 7 through the display control unit 8 (step S105).

  Therefore, when the accumulated amount of packets is small, a comment “There is a possibility that the line is congested and the sound quality is bad” is displayed, and the cause of the deterioration of the sound quality is notified.

  If the accumulation time of the voice data packet is not less than 0.1 seconds (“No” in step S106), the control unit 4 determines that the output level (voice output level) to the speaker 14 on the communication partner side is It is determined whether or not it is less than 20% of the maximum output level (specified value) to the speaker 14 (step S108). If it is less than 20% (“Yes” in step S108), the comment A to be displayed is “ Adjust the volume of the speaker of the other party's phone ”is set (step S109). Further, since the comment A is set (“No” in step S104), the control unit 4 controls the display of the comment A “Adjust the volume of the speaker of the other party telephone” set in step S109. The information is displayed on the field 27 of the screen 7a of the display unit 7 through the unit 8 (step S105).

  Accordingly, when the output level to the speaker 14 on the communication partner side is low, a comment “Please adjust the volume of the speaker on the partner phone” is displayed, and the output level to the speaker 14 on the communication partner side is displayed. Adjustment is encouraged.

  In addition, if the output level to the speaker 14 on the communication partner side is not less than 20% of the maximum output level to the speaker 14 (“No” in step S108), the control unit 4 determines the pseudo echo signal of the communication partner side. It is determined whether or not the level is less than 20% of the maximum level (specified value) (step S110). If the level is less than 20% (“Yes” in step S110), “other party telephone” is displayed as the comment A to be displayed. Check the speaker wiring and adjust the microphone volume. "(Step S111) Further, since the comment A is set (“No” in step S104), the control unit 4 confirms the wiring of the speaker of the other party telephone set in step S111 and adjusts the microphone volume. Please display "on the field 27 of the screen 7a of the display unit 7 through the display control unit 8 (step S105).

  Therefore, when the level of the pseudo echo signal in the videophone terminal device on the communication partner side is low, a comment “Please check the speaker wiring of the partner phone and adjust the microphone volume” is displayed. Thus, confirmation of the operation of the speaker 14 and the microphone 15 on the communication partner side is prompted.

  If the level of the pseudo echo signal on the communication partner side is not less than 20% of the maximum level (“No” in step S110), the control unit 4 outputs the output level to the speaker 14 on the own side (sound output level). Is less than 20% of the maximum output level (specified value) to the speaker 14 (step S112), and if it is less than 20% (“Yes” in step S112), the comment A to be displayed Is set as “Check speaker volume” (step S113). Further, since the comment A is set (“No” in step S104), the control unit 4 displays the comment A “Please check the speaker volume” set in step S113 through the display control unit 8. 7 is displayed in the column 27 of the screen 7a (step S105).

  Accordingly, when the output level to the self-side speaker 14 is low, a comment “Please adjust the volume of the speaker.” Is displayed, and the adjustment of the output level to the self-side speaker 14 is prompted.

If the output level to the speaker 14 on the self side is not less than 20% of the maximum output level (“No” in step S112), the control unit 4 regards that the comment A is not set (step S104). "Yes"), the comment A displayed in the column 27 of the screen 7a of the display unit 7 is deleted through the display control unit 8 (step S114).
As described above, the input level from the microphone 15 in the TV phone terminal device on the self side is low, the amount of accumulated packets is small, the output level to the speaker 14 in the TV phone terminal device on the communication partner side is low, the communication partner It is successively determined that the level of the pseudo echo signal in the videophone terminal device on the side is low and the output level to the speaker 14 in the videophone terminal device on the self side is low, and appropriate comments are displayed respectively. The user can look at these comments and perform appropriate processing for each.

  For example, when the user sees a comment “Please check the microphone volume”, the user can operate the input operation unit 5 to input an appropriate input sensitivity of the microphone 15. The control unit 4 controls the microphone sensitivity adjustment unit 16 to set an appropriate input sensitivity of the microphone 15. Thereby, the input sensitivity of the microphone 15 is improved.

  In addition, when the user sees a comment “There is a possibility that the line is congested and the sound quality is poor.”, The communication between each TV phone terminal device 1-1 and 1-2 is not performed. It is possible to detect that the communication is not normally performed and to interrupt communication or wait for the line to be restored.

  Alternatively, when the user sees a comment “Please adjust the volume of the speaker.”, The user can operate the input operation unit 5 to input an appropriate output level to the speaker 14. The control unit 4 controls the speaker volume adjustment unit 13 to set an appropriate output level to the speaker 14. Thereby, the volume of the speaker is improved.

  In addition, the user comment “Please adjust the volume of the speaker of the other party's phone” or “Please check the wiring of the speaker of the other party's phone and adjust the microphone volume.” Can be improved by remotely controlling the output level of the communication partner speaker 14 or the input sensitivity of the microphone 15.

  Such remote control is performed according to the communication protocol shown in FIG. Next, a procedure for remotely controlling the output level to the speaker 14 on the communication partner side or the input sensitivity of the microphone 15 will be described with reference to the communication protocol of FIG.

  For example, in the TV phone terminal device 1-1, it is assumed that a comment “Please adjust the volume of the speaker of the other party phone” is displayed in the column 27 of the screen 7a of the display unit 7. At this time, the user operates the input operation unit 5 to input an appropriate output level to the speaker 14 in the TV telephone terminal device 1-2 on the communication partner side (step S201). In response to this, the control unit 4 forms a packet including control data indicating the output level to the speaker 14 on the communication partner side instructed to input, and transmits the packet from the Internet communication unit 2 to the communication partner side via the Internet IN. Is transmitted to the TV telephone terminal apparatus 1-2 (step S202).

  In the TV phone terminal 1-2, when a packet including control data is transmitted from the TV phone terminal 1-1 through the Internet IN, the Internet communication unit 2 receives the packet (step S203), and the packet is stored in the buffer memory. 3 is input to the control unit 4, and control data is extracted from the packet by the control unit 4. When the control unit 4 extracts the control data, the control unit 4 acquires the output level to the speaker 14 indicated by the control data, and controls the speaker volume adjustment unit 13 to set the output level to the speaker 14 indicated by the control data. (Step S204).

  As a result, the output level to the speaker 14 in the TV telephone terminal apparatus 1-2 on the communication partner side is changed to the output level instructed to be input by the TV telephone terminal apparatus 1-1.

  Thereafter, the control unit 4 of the TV phone terminal apparatus 1-2 forms a packet including control data indicating that the output level to the speaker 14 has been changed, and transmits the packet from the Internet communication unit 2 through the Internet IN. The data is transmitted to the TV phone terminal device 1-1 (step S205).

  In the videophone terminal device 1-1, the Internet communication unit 2 receives the packet (step S206), the packet is input to the control unit 4 through the buffer memory 3, and the control unit 4 extracts control data from the packet. When the control data is extracted, the control unit 4 displays on the screen 7a of the display unit 7 that the output level to the speaker 14 on the communication partner side indicated by the control data has been changed (step S207).

  In addition, the comment “Please check the speaker wiring of the other party's telephone and adjust the microphone volume” is displayed in the column 27 of the screen 7a of the display unit 7 on the TV phone terminal device 1-1. Sometimes, when the user operates the input operation unit 5 to input an appropriate input sensitivity of the microphone 15 in the TV telephone terminal device 1-2 on the communication partner side (step S201), the microphone on the communication partner side is designated. A packet including control data indicating 15 input sensitivities is formed, and this packet is transmitted to the TV telephone terminal device 1-2 on the communication partner side via the Internet IN (step S202).

  In the videophone terminal device 1-2, the Internet communication unit 2 receives the packet (step S203), the control unit 4 extracts the control data from the packet, and acquires the input sensitivity of the microphone 15 indicated by the control data, The microphone sensitivity adjustment unit 16 is controlled to set the microphone 15 to the input sensitivity indicated by the control data (step S204).

  Thereafter, a packet including control data indicating that the input sensitivity of the microphone 15 has been changed is transmitted and received from the TV phone terminal device 1-2 to the TV phone terminal device 1-1 (each step S205, S206), and the communication partner The fact that the input sensitivity of the microphone 15 on the side has been changed is displayed on the screen 7a of the display unit 7 (step S207).

  With the same procedure, the output level to the speaker 14 and the input sensitivity of the microphone 15 in the TV phone terminal device 1-1 can be remotely controlled from the TV phone terminal device 1-2.

  As described above, the TV telephone terminal apparatus receives the level of the pseudo echo signal on the communication counterpart side, and confirms the operation of the speaker and microphone on the communication counterpart side based on the level of the pseudo echo signal. The pseudo echo signal indicates a sound that circulates from the speaker on the communication partner side to the microphone, and is not affected by ambient noise or the like on the communication partner side. For this reason, it is possible to reliably check the operation of the speaker and microphone on the communication partner side.

  Further, since not only the level of the pseudo echo signal on the communication partner side but also the output level of the voice signal to the speaker 14 on the communication partner side and the input level of the voice signal from the microphone 15 on the own side are referred to, the communication partner It is possible to confirm whether the sound output level of the speaker 14 on the side and the input sensitivity of the microphone 15 on the own side are set appropriately.

  Further, since the accumulated amount of received voice data packets is referred to, it is possible to detect a line failure.

  Therefore, it is possible to immediately detect a problem in a call and to easily identify the cause.

  In addition, this invention is not limited to the said embodiment, It can deform | transform variously. For example, the present invention can be applied to TV phone communication between three or more TV phone terminal apparatuses. In this case, the management authority for each of the other TV telephone terminal apparatuses is given to one TV telephone terminal apparatus, and the level of the pseudo echo signal in each of the other TV telephone terminal apparatuses in the TV telephone terminal apparatus having the management authority. May be displayed, and the output level of the speaker and the input sensitivity of the microphone in other TV telephone terminal devices may be remotely controlled.

  Further, the echo canceller is not limited to the configuration shown in FIG. In this case, the estimated level of the echo that propagates through the space and is input to the microphone may be the “level of the pseudo echo signal (FIG. 3)” of the present invention. The simplest configuration of an echo canceller has an arithmetic unit that samples an audio signal input to a speaker, delays the sampled audio signal by the propagation time of a sound wave from the speaker to a microphone, and attenuates the amplitude thereof. This delayed and attenuated audio signal (pseudo echo) is added to the audio signal output from the microphone. Even an echo canceller having such a simple configuration can be used. Of course, a more complicated and advanced configuration is more preferable.

  Moreover, although the thing which communicates through the internet is illustrated as a TV telephone terminal device, what communicates through ISDN etc. may be applied.

  The present invention includes not only a communication system or a TV phone terminal device but also a volume monitoring device for remotely confirming the operation of a speaker and a microphone. For example, in premises broadcasting, a sound signal is sent from a broadcast room to a speaker in another room and a sound is output from a speaker in another room. Therefore, a microphone is attached near the speaker in the other room, and the speaker and the microphone An echo canceller is provided between them, a pseudo echo signal is output from the echo canceller, and the pseudo echo signal is transmitted to the broadcast room. Accordingly, the operation of the speaker can be confirmed based on the pseudo echo signal on the broadcast room side without being affected by noise in other rooms.

  Alternatively, even in a concert venue, if a microphone is attached near the speaker and an echo canceller is provided between the speaker and the microphone, it will be affected by the noise in the venue based on the pseudo echo signal output from the echo canceller. The operation of the speaker can be confirmed without any problem.

  Furthermore, the present invention also includes programs such as an echo canceller applied to such a TV phone terminal device and a volume monitoring device, and a computer operating as an echo canceller. By using the pseudo echo signal output from the echo canceller of the present invention, such a TV phone terminal device and a sound volume monitoring device can be realized.

  INDUSTRIAL APPLICABILITY The present invention can be used for confirmation of the operation of a local broadcasting speaker, the confirmation of the operation of a speaker in a concert hall, and the operation of a speaker and a microphone of a videophone.

It is a block diagram which shows one Embodiment of the communication system of this invention. It is a figure which illustrates the display screen in the TV telephone terminal device of the communication system of FIG. It is a block diagram which shows the structure of the echo canceller in the TV telephone terminal device of the communication system of FIG. FIG. 2 is a flowchart showing a process of normalization support for display and TV phone communication in the TV phone terminal apparatus of the communication system of FIG. It is a figure which shows the communication protocol for the remote control performed between each TV telephone terminal device of the communication system of FIG.

Explanation of symbols

1-1, 1-2 Videophone terminal device 2 Internet communication unit 3 Buffer memory 4 Control unit 5 Input operation unit 6 Image decoding unit 7 Display unit 8 Display control unit 9 Video camera 11 Image encoding unit 12 Audio decoding unit 13 Speaker volume Adjustment unit 14 Speaker 15 Microphone 16 Microphone sensitivity adjustment unit 17 Voice coding unit 18 Echo canceller

Claims (10)

A speaker and a microphone;
A sound volume monitoring apparatus comprising: an echo level measuring unit that inputs at least an audio signal applied to the speaker, obtains an echo level of audio from the speaker to the microphone, and outputs the echo level.   2. The sound volume monitoring apparatus according to claim 1, further comprising notification means for inputting an echo level output from the echo level measurement means and notifying the echo level. In a communication terminal device that performs communication through a network,
A speaker and a microphone used for calling;
An echo level measuring means for inputting at least an audio signal applied to the speaker, obtaining an echo level of the audio from the speaker to the microphone, and outputting the echo level;
A communication terminal apparatus comprising: a transmission unit that transmits the echo level output from the echo level measurement unit to a communication partner. Voice level detection means for detecting a level of a voice signal received from the communication partner and applied to the speaker;
The communication terminal apparatus according to claim 3, wherein the transmission unit transmits the level of the audio signal detected by the audio level detection unit together with the echo level. In a communication terminal device that performs communication through a line network,
Receiving the echo level or the level of the audio signal from the communication partner, comprising a notification means for informing the level of the echo level or the audio signal,
The echo level is an echo level of sound from a speaker to a microphone in the communication partner,
The level of the audio signal is a level of an audio signal received by the communication partner and applied to the speaker.   6. The communication terminal apparatus according to claim 5, further comprising remote control means for remotely controlling the communication partner to adjust the output level of the speaker or the input sensitivity of the microphone at the communication partner. In a communication system that performs mutual communication between a first terminal device and a second terminal device through a network,
The first terminal device inputs at least a speaker and a microphone used for a call with the second terminal device, and an audio signal applied to the speaker, and obtains an echo level of audio from the speaker to the microphone, Echo level measuring means for outputting the echo level, and transmitting the echo level output from the echo level measuring means to the second terminal device,
The second terminal device includes a notification unit that receives the echo level and notifies the echo level. In a communication method for performing mutual communication between a first terminal device and a second terminal device through a circuit network,
The first terminal device includes a speaker and a microphone used for a call with the second terminal device, obtains an echo level of sound from the speaker to the microphone, and sends the echo level to the second terminal device. Send
The second terminal device receives the echo level and notifies the echo level. Measuring means for inputting at least an audio signal applied to the speaker and measuring an echo level of the audio from the speaker to the microphone;
Forming a pseudo echo signal having an echo level obtained by the measuring means, and adding the pseudo echo signal to an audio signal output from the microphone, and
The echo canceller according to claim 1, wherein the measuring means includes output means for outputting the echo level. A measurement step of measuring at least an audio signal applied to the speaker and measuring an echo level of the audio from the speaker to the microphone;
Forming a pseudo echo signal of the echo level obtained in the measurement step, and adding the pseudo echo signal to the audio signal output from the microphone;
A computer-readable program for causing an echo canceller to function, comprising: an output step for outputting the echo level obtained in the measurement step.

Images