JP2013141182A - Interaction environment reproduction method and device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an interaction environment reproduction method which allows for confirmation of echo occurrence situation in the interaction environment of the other side interlocutor, in its own interaction environment.SOLUTION: First test sound data recorded in interaction environment where its own conference terminal is installed as a test sound source is stored in a recording unit, reproduction sound of the first test sound data is taken in via a microphone, and the environmental data thus taken in is stored in the recording unit as second test sound data. The second test sound data thus stored includes the information of interaction environment where its own conference terminal is installed, and echo occurrence situation in the interaction environment where its own conference terminal is installed is reproduced by reproducing the second test sound data via a speaker.

Description

  The present invention relates to an interactive environment reproduction method in an interactive dialogue system for realizing a video conference, a telephone conference, etc. between a plurality of information terminals connected to each other to a predetermined transmission means, and an apparatus for realizing the interactive environment reproduction method. In particular, in the interactive environment where the information terminal of the user is installed (the user's own dialog environment), audio data such as voice and environmental sound among the electronic data to be transmitted to the information terminal of the other party's dialog Thus, the present invention relates to a technique for reproducing the dialogue environment of the other party's dialogue person in the own dialogue environment.

  Conventionally, an application using a personal computer (hereinafter referred to as a PC) connected to a network represented by the Internet that realizes wired or wireless data communication, such as an existing general telephone line network, an optical network, a dedicated line, etc. In addition, interactive dialogue systems (also called web conferences) such as video conferences and telephone conferences that exchange data / images, videos, audio information, etc. with one or more people in remote locations are used (Patent Literature). 1). When exchanging electronic data such as voice in this interactive dialogue system, in addition to the microphone and speaker built in or connected to the PC, a headset connected to the audio terminal or USB terminal, a dedicated receiver connected to the PC, etc. Is also used.

  Such an interactive dialogue system has a problem of echo generated in the environment of the other party's dialogue due to different dialogue environments for each of the dialogues. Research on canceling technology is actively conducted.

Japanese Patent No. 4706439 Specification JP 2008-141735 A

  As a result of studying the echo canceling technique applied to the conventional interactive dialog system as described above, the inventors have found the following problems. In other words, in a conventional interactive dialogue system, there are various conditions such as the installation environment of an information terminal such as a PC (interactive environment such as reverberation and presence of environmental noise), the position of the speaker with respect to a sound collector such as a microphone, and the volume of voice. Echo may occur depending on the situation.

  For this reason, various techniques for removing echoes and howling have been proposed, such as the above-mentioned Patent Document 2, but in an actual interactive environment, various spatial structures (including the arrangement of related equipment), installation locations and orientations. There is a voice volume of the speaker, and it is difficult to realize sufficient echo cancellation in all use situations.

  In particular, since echo is generated in the dialog environment of the other party's dialog, the user who is the main echo source cannot recognize the occurrence of echo. For this reason, it has been difficult to make adjustments for echo cancellation in the conversation environment of the other party's conversation.

  The present invention has been made in order to solve the above-described problems, and in an interactive dialogue system that realizes a video conference, a conference call, etc. between a plurality of information terminals connected to a predetermined transmission means. Dialog environment reproduction method and dialog environment reproduction that enable the dialog person himself / herself to reproduce the conversation environment (echo occurrence state) of the other party's talker in the dialog environment (self-conversation environment) in which his / her information terminal is installed An object is to provide an apparatus for implementing the method.

  The interactive environment reproduction method according to the present invention relates to an interactive environment reproduction method in a two-way interactive system that realizes a video conference, a telephone conference, etc. between a plurality of information terminals connected to a predetermined transmission means. It is executed as confirmation work. In other words, the reproduction method reproduces the echo generation situation in the dialogue environment where its information terminal is installed, so that the dialogue environment of the other party is confirmed in advance (confirmation before starting the interactive dialogue). Enable.

  Here, the predetermined transmission means is a concept including a local LAN and a home LAN as well as a general communication network such as the public line, a form telephone line, etc., regardless of wired or wireless, such as the Internet. It means all communication paths located between information terminals (information processing devices such as PCs) that perform transmission and reception. The data exchanged between the information terminals is electronic data (which may be either digital or analog) including at least audio data.

  In the interactive environment reproduction method according to the present embodiment, the first test sound data is stored in the recording means of the own information terminal as a test sound source recorded in the interactive environment where the own information terminal is installed. The first test sound data is preferably audio data such as voice and environmental sound. The environmental sound includes external noise, equipment noise, etc. in addition to music and artificially created sound effects. . In addition, the first test sound data is obtained through various acquisition routes. For example, the first test sound data is electronic data stored in advance in recording means of another information terminal connected to predetermined transmission means (digital or analog data previously taken in through the microphone of its own information terminal) In some cases, the first test sound data can be acquired via a predetermined transmission means. Also, when there is no test sound source (first test sound data) recorded in advance on the network, the electronic data captured through the microphone of the own information terminal is used as the first test sound data. It may be stored in the recording means.

  In the interactive environment reproduction method according to the present embodiment, a sound based on the first test sound data stored in the recording unit as described above is reproduced through the speaker of the own information terminal while the microphone of the own information terminal is used. Like the first test sound data, the second test sound data fetched via this is stored in the recording means as environment data relating to its own dialogue environment. Since the second test sound data is data obtained by capturing the first test sound data reproduced in the environment where the information terminal is installed through the microphone, the second test sound data is inherently the other party's dialogue person. Corresponds to environmental data (audio data such as voices and environmental sounds heard by the other party's dialog through a speaker).

  Therefore, in the interactive environment reproduction method according to the present embodiment, the sound based on the second test sound data is reproduced via the speaker of the own information terminal, thereby echoing in the interactive environment where the own information terminal is installed. The occurrence situation can be reproduced in the dialogue environment of the dialogue person. It is possible to realize a configuration in which the reproduced echo occurrence state can be visually displayed using a predetermined display means such as an LED. At that time, the reproduced echo occurrence situation is determined based on the volume information of the echo component (difference data between the first test sound data and the second test sound data) included in the second test sound data, A configuration in which the determination result is visually displayed using a predetermined display means can also be realized. In particular, the visual display of the determination result is effective as an index for objectively evaluating the state of maintenance of the conversation environment.

  In the dialog environment reproduction method according to the present embodiment, an information terminal that contributes to a two-way dialog (at least an information terminal installed in the dialog environment of the other-party talker) may have at least an echo canceling function.

  Furthermore, the interactive environment reproduction method according to the present invention is recorded on a computer readable / writable external recording medium (information recording medium) such as a hard disk, CD, DVD, or Blu-ray as a computer program that can be realized by a computer such as the PC. May be.

  In addition, an apparatus (apparatus according to the present invention) that realizes the above-described interactive environment reproduction method includes at least a control unit, a recording unit, and a display unit. The control means executes the above-described interactive environment reproduction method. The recording means is an electronic device capable of reading and writing electronic data. The display means generates an echo component included in the second test sound data stored in the recording means (including the case where the echo component is reproduced at a volume higher than a predetermined value and the volume of the echo component changes) Is displayed visually. Moreover, in order to objectively evaluate the maintenance state of the dialogue environment, the apparatus may further include a determination unit. The determination means determines the echo occurrence state reproduced by the control means based on the volume information of the echo component included in the second test sound data. At that time, the display means visually displays the determination result of the determination means in accordance with a predetermined determination level.

  The embodiments according to the present invention can be more fully understood from the following detailed description and the accompanying drawings. These examples are given for illustration only and should not be construed as limiting the invention.

  Further scope of applicability of the present invention will become apparent from the detailed description given below. However, the detailed description and specific examples, while indicating the preferred embodiment of the invention, are presented for purposes of illustration only and various modifications and improvements within the scope of the invention may It will be apparent to those skilled in the art from the detailed description.

  The interactive environment reproduction method and apparatus according to the present invention determines whether or not there is a trouble such as an echo generated in a bidirectional conversation such as a video conference and a telephone conference between a plurality of information terminals via a network before the interactive conversation is started. This is a technology for checking in advance. By using the reproduction method, the interlocutor confirms in advance the echo that may occur in the other party's dialogue environment in the dialogue environment of the other party, thereby changing the arrangement method of the microphone or speaker, etc. Therefore, it is possible to take measures for echo cancellation.

It is a figure which shows the structural example of the interactive dialogue system (video conference system) to which the interactive environment reproduction method which concerns on this embodiment is applicable, and the structural example of the terminal for a meeting (the apparatus which concerns on this embodiment). It is a figure which shows the other structural example of the interactive dialogue system (voice conference system) which can apply the dialogue environment reproduction method which concerns on this embodiment. It is a figure for demonstrating the example of a structure of an echo generation | occurrence | production mechanism and an echo canceling circuit. It is a flowchart for demonstrating an example of the interactive environment reproduction method which concerns on this embodiment. It is a figure for demonstrating schematic operation | movement in the terminal for meetings which performs the interactive environment reproduction method which concerns on this embodiment, especially an audio interface (a voice interface is included). It is a figure which shows the waveform of the reproduction | regeneration audio | voice and the waveform of an echo component in each process of the dialogue environment reproduction method which concerns on this embodiment. It is a figure which shows the various structural examples of an LED alarm.

  Hereinafter, embodiments of the interactive environment reproduction method and apparatus according to the present invention will be described in detail with reference to FIGS. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted. Audio data such as voice and environmental sounds (including music, artificially produced sound effects, external noise, equipment noise, etc.) can be used as test sound sources to reproduce the interactive environment. However, in the following description of the embodiment, for the sake of simplicity, a detailed description will be given only for the case of using audio data as a digital sound source.

  FIG. 1 shows a configuration example of an interactive dialogue system (video conference system) to which the interactive environment reproduction method according to the present embodiment can be applied, and a configuration example of a conference terminal (including the device according to the present embodiment). FIG. FIG. 1 (a) shows a system configuration (minimum unit) for a conversation person 30A and a partner conversation person 30B to execute a one-to-one interactive conversation via a network (predetermined transmission means) 10. ing.

  That is, a conference terminal (an information terminal such as a PC) 20A connected to the network 10 is installed on the side of the interlocutor 30A. The conference terminal 20A includes peripheral devices that form part of the video interface. For example, an imaging unit 41A such as a CCD camera for imaging the conversation person 30A and the like, and a monitor (display means) 42A for displaying an image of the other party conversation person 30B are connected. In addition, the conference terminal 20A captures the sound of peripheral devices constituting a part of the audio interface (including the voice interface), for example, the speaker 51A for reproducing the voice from the other party talker 30B and the voice of the talker 30A. A microphone 52A is connected.

  On the other hand, a conference terminal 20B connected to the network 10 is installed on the other party talker 30B side, and the conference terminal 20B includes peripheral devices that constitute part of the video interface, for example, the other party conversation. An imaging unit 41B for imaging the person 30B and the like, and a monitor 42B for displaying an image of the conversation person 30A and the like are connected. Also, the conference terminal 20B is connected to peripheral devices that constitute part of the audio interface, for example, a speaker 51B that reproduces sound from the talker 30A, and a microphone 52B that captures the voice of the other party talker 30B. Yes.

  Each of the conference terminals 20A and 20B described above has a structure as shown in FIG. The conference terminals 20A and 20B have the same structure, and the subscripts A and B are omitted from the reference numerals of the respective parts shown in FIG.

  The conference terminal 20 (20A, 20B) has a data input / output unit (hereinafter referred to as I / O) 221 as an interface for connecting to the network 10 as a predetermined transmission means, a keyboard, a pointing device, and an external storage device. I / O 222 for exchanging data with peripheral devices such as the above. In addition, the conference terminal 20 cancels echoes generated due to the conversation environment of the storage unit (recording unit) 230 for storing various audio data and video data, and the conversation party 30A and the other party conversation party 30B. Echo canceling circuit 240, digital / analog converter (hereinafter referred to as D / A) 251 for enabling audio data (digital data) to be output to speaker 51 (51A, 51B), microphone 52 (52A, 52B) The video information sent from the network 10 via the analog / digital converter (hereinafter referred to as A / D) 252 and I / O 221 for converting the audio (analog data) taken in from the digital signal into the digital data is monitored 42. (42A, 42B) and the drawing unit 260 for displaying on each, and each of the conference terminal 20 And a control unit (control means) 210 for controlling the operation content and the operation timing.

  The display means is not limited to the monitor 42 electrically connected to the main body of the conference terminal 20, and includes a liquid crystal monitor 261 and an LED alarm 262 attached to the main body. The liquid crystal monitor 261 and the LED alarm 262 are effective as display means for visually displaying the degree of echo generation status reproduced by the control unit 210. In particular, when the control unit 210 functions as a control unit that executes the interactive environment reproduction method according to the present embodiment, and also functions as a determination unit that determines a maintenance state of the interactive environment, the control unit 210 includes the liquid crystal monitor 261, The drawing unit 260 is controlled to display the determination result on the display means such as the LED alarm 262 and the monitor 42.

  Among the above-described components, the control unit 210, the storage unit 230, the echo canceling circuit 240, the D / A 251, the A / D 252, the speaker 51, and the microphone 52 constitute the audio interface 200A. The control unit 210, the storage unit 230, the drawing unit 260, the monitor 42, and the imaging unit 41 constitute a video interface 200A.

  Further, the interactive dialogue performed through the network 10 is not limited to the one-to-one configuration as shown in FIG. For example, the interactive environment reproduction method according to the present embodiment is effective even for one-to-many and many-to-many interactive conversations when a plurality of interlocutors participate in at least one interactive environment.

  That is, FIG. 2 is a diagram illustrating another configuration example of the interactive dialogue system (voice conference system) to which the dialogue environment reproduction method according to the present embodiment can be applied.

  In the interactive dialogue system shown in FIG. 2, one conference terminal 20A connected via the network 10 is installed in the venue A (interactive environment 400A), and the other conference terminal 20B is installed in another venue B ( Installed in the interactive environment 400B). The many-to-many interactive dialogue is managed by the conference server 300 connected to the network 10. The conference server 300 exchanges data and the like with the conference terminals 20A and 20B via the network 320 and the storage unit 320 that stores the conference schedule and the recording data (voice, video, text, etc.) of the proceedings. I / O 310 for performing at least.

  A plurality of conversation persons 31A (each corresponding to the conversation person 30A in FIG. 1A) participates in the conversation environment 400A of the venue A, and for the conference via the network 10 in front of the conversation person 31A. A conference terminal 20A having an I / 221 for exchanging data with the server 300 and the interactive environment 400B at the venue B is installed. At least a speaker 51A and a microphone 52A are connected to the conference terminal 20A. Of course, a monitor and an imaging unit may be connected to the conference terminal 20A. Similarly, in the conversation environment 400B of the venue B, a plurality of other-party talkers 31B (each corresponding to the other-party talker 30B in FIG. 1 (a)) participate in the dialogue environment 400B. Are provided with a conference terminal 20B having an I / O 221 for exchanging data with the conference server 300 and the interactive environment 400A of the venue A via the network 10. At least a speaker 51B and a microphone 52B are connected to the conference terminal 20B, and of course, a monitor and an imaging unit may be further connected.

  When voice data is exchanged in the one-to-one, one-to-many, and many-to-many interactive conversations as described above, the installation environment of the conference terminal 20 (interactive environment such as the presence of echoes and the presence of environmental noise), the collection of microphones, and the like It is operated under various conditions such as the position of the speaker relative to the sound device and the volume of the voice, and an echo may occur depending on the situation.

  FIG. 3A is a diagram for explaining the echo generation mechanism. Normally, when the interlocutor 30A and the other-party talker 30B perform a two-way dialogue via the network 10, the voice A of the talker 30A is captured from the microphone 52A and reproduced by the speaker 51B, thereby causing the other-party talker 30B. Listened to. On the other hand, the voice B of the other party talker 30B is also taken in by the microphone 52B and is heard by the talker 30A by being reproduced by the speaker 51A. At this time, there is a possibility that part of the voice A reproduced and output from the speaker 51B is taken into the microphone 52B as the echo component 36 in the conversation environment where the other party conversation person 30B exists. The echo component 36 includes a component that is directly captured by the microphone 52B, a component that is reflected by the obstacle 35, and a component that is reflected by the other-party talker 30B itself. Eventually, in the conversation environment where the conversation person 30A exists, the echo component 36 is reproduced and output from the speaker 51A together with the voice B of the other party conversation person 30B.

  The feature of echo generation in the two-way dialogue as described above is that neither the conversation party 30A nor the other party conversation person 30B can confirm the voice of the other party that is played in the conversation environment of the other party. The two-way dialogue is being performed without confirming whether or not an echo has occurred. If such a situation is left unattended, smooth interactive dialogue may not be performed. In recent years, a conference terminal equipped with an echo canceling circuit 240 as shown in FIG. It has come to be used. That is, the echo canceling circuit 240 inputs voice data through a line and is captured from the voice switch 242 provided on the path output from the speaker 51B via the D / A 251 and the microphone 52B via the A / D 252. To control the voice switch 243, the echo suppressor 245, the adaptive filter 241 for subtracting the echo component from the captured digital data of the voice B, and the voice switches 242, 243 provided on the path for outputting the voice B on the line Voice switch control unit 244.

  The adaptive filter 241 predicts the echo component 36 that returns to the microphone 52B and removes it from the audio data output from the A / D 252. The echo suppressor 245 performs processing for reducing the residual component of echo component removal by the adaptive filter 241. In addition, the voice switches 242 and 243 perform volume adjustment between the line input and the line output so that howling is suppressed by the voice switch control unit 244 controlling to an appropriate volume.

  The principle of echo canceling is that the voice component to be reproduced is already transmitted in the voice environment of the other party (for example, the other party talker 30B) in the own conversation environment (for example, the other party 30A). In the dialogue environment of the other party (for example, the other party dialoger 30B), the voice component to be transmitted (for example, the talker 30A) that has already been reproduced in the voice of the other party is deleted. This is done by deleting from the data. Specifically, as an example, a pseudo echo signal resembling an echo component transmitted from the other party is generated, and the echo component is canceled by subtracting the pseudo echo signal from the actual echo component (echo signal). The same processing is performed when the user's own voice is transmitted due to the reverberation of the other party's dialogue environment (room, etc.). There are a plurality of algorithms for executing such echo canceling, and some of them automatically calculate the balance between the generated echo component and the necessary pseudo echo component, as in the NLMS (learning identification method) algorithm.

  Next, an example of the interactive environment reproduction method according to the present embodiment will be described in detail with reference to FIGS. The following description of the operation is performed before the interactive conversation is started in the conversation person 30B (FIG. 1A) or the conversation environment 400B in the venue B (FIG. 2). FIG. 4 is a flowchart for explaining an example of the interactive environment reproduction method according to this embodiment. FIG. 5 is a diagram for explaining a schematic operation in a conference terminal for executing the interactive environment reproduction method according to the present embodiment, particularly in an audio interface. FIG. 6 is a diagram showing the waveform of the reproduced voice and the waveform of the echo component in each step of the interactive environment reproduction method according to this embodiment.

  The operation mode of the conference terminal 20 shown in FIG. 1A and the like includes a normal interactive dialog mode, an echo canceling mode in which interactive conversation is performed while performing echo canceling, and before the interactive conversation starts. There is a test mode (a mode for executing the interactive environment reproduction method according to the present embodiment) for confirming the echo occurrence status of the other party's dialog side, but the audio interface 200A is particularly involved in the conference terminal 20 below. The test mode will be described in detail.

  First, one of the interlocutors who starts the test mode speaks for a certain period of time to the conference terminal that is installed in his / her interactive environment. The conference terminal obtains test voice data (digital data as a test sound source) by recording the speech content (voice) of the conversation person based on a preset recording volume value (step 1). ST10). Specifically, as shown in FIG. 5A, the test sound (test sound source) captured from the microphone 52 of the audio interface 200A of the conference terminal via the A / D 252 is transmitted to the control unit 210. Thus, the data is stored in the storage unit 230 as data 1 (first audio data corresponding to the first test sound data).

  Subsequently, the audio interface 200A reproduces and outputs the data 1 stored in the storage unit 230 from the speaker 51 via the D / A 251 as a test audio based on a preset reproduction volume value. At the same time, the reproduced sound from the speaker 51 is taken into the audio interface 200A from the microphone 52 via the A / D 252 (step ST20). That is, as shown in FIG. 5B, in the audio interface 200A, the audio data (second audio data corresponding to the second test sound data) captured by the control unit 210 based on a predetermined recording volume value is provided. Is stored in the storage unit 230 as data 2. Thus, the data 2 stored in the storage unit 230 is environment data (voice) of the interactive environment in which the test mode is executed. Further, when the data 2 is stored, if the audio interface 200A includes the echo canceling circuit 240, an echo canceling operation may be performed when the reproduced sound is captured. In addition, the waveform of the sound reproduced and output from the speaker 51 in step ST20 is shown in FIG.

  In this test mode, the data 2 (environment data of the interactive environment in which the test mode is executed) stored in the storage unit 230 is reproduced and output from the speaker 51 (step ST30). That is, as shown in FIG. 5C, in the audio interface 200A, the control unit 210 reads the data 2 stored from the storage unit 230, and the read data 2 becomes a predetermined reproduction volume value. Based on this, reproduction is output from the speaker 51 via the D / A 251. By listening to the reproduced sound (confirmation sound) in step ST30, the conversation person performing the test mode can confirm the state of echo occurrence in his / her conversation environment (step ST40).

  Note that when data 2 is stored in the storage unit 230 in step ST20, if echo canceling is functioning effectively, the echo component is removed from the sound based on the data 2 reproduced in step ST30. The echo component (difference between data 2 and data 1) at that time has a waveform as shown in FIG.

  On the other hand, when the data 2 is stored in the storage unit 230 in step ST20, if the echo canceling is not sufficiently functioning, an echo component remains in the sound based on the data 2 reproduced in step ST30. The echo component has a waveform as shown in FIG. In this case, when an actual interactive dialogue is performed, an echo is heard on the other side.

  As the echo confirmation performed in step ST40, for example, by simply confirming that the amplitude of the speech waveform reproduced in step ST30 is not output above a certain value, it is possible to distinguish between the echo component and an appropriate input speech component. become. This identification is performed based on whether or not the sound waveform reproduced in step ST20 and the sound reproduced in step ST30 are the same. This identification can also be performed by Fourier transforming the reproduced sound and comparing the frequency components.

  If echo generation is confirmed in step ST40, for example, improvement of the conversation environment (sound absorption by installing a curtain or the like), separation of the distance between the microphone and the speaker, adjustment of the direction of the microphone or the speaker, adjustment of the reproduction volume. For example, the sound reproduction environment (dialogue environment) is adjusted (step ST50).

  If the volume (volume) of the sound reproduced in step ST20 is not appropriate, the microphone volume, speaker volume, etc. are adjusted so that the volume is appropriate, and the test mode is started from step ST10.

  In step ST10, the data 1 stored in the storage unit 230 is not limited to digital data captured from the microphone 52 via the A / D 252. For example, the audio data acquired in the same environment as the installation environment of the microphone 52 previously made available in a server (for example, the storage unit 310 of the conference server 300) connected to the network 10 is acquired via the I / O 221. The acquired audio data may be stored in the storage unit 230 as test audio data. At that time, the data 1 is preferably prepared in advance for each venue (conference room) to be used. If data 1 is stored in the conference server 300 or the like, the data 1 can be used as test audio data when necessary, such as when a conference terminal is newly introduced into the venue. It is also possible to confirm the minimum microphone volume required to secure the playback volume in the other party's interactive environment (conference room), and to set a limit so that the microphone volume value cannot be lowered when adjusting the volume. is there.

  As described above, the control unit 210 that reproduces the echo occurrence state in its own dialogue environment in step ST40 can also function as a determination unit that determines the maintenance state of the dialogue environment based on the reproduced echo occurrence situation. . In this case, the control unit 210 controls the drawing unit 260 so that the determination result is visually displayed on the liquid crystal monitor 261 and the LED alarm 262 attached to the conference terminal body. The determination result may be displayed on the monitor 42 connected to the conference terminal.

  FIG. 7 is a diagram illustrating various configuration examples of the LED alarm 262 as an example of display control by the control unit 210.

  In the example of FIG. 7A, the LED alarm 262A needs to maintain the dialog environment, LED 1 (LED indicating “OK”) indicating that the echo occurrence status is suppressed to a level at which the dialog can be started. LED2 (LED of "NO" display) which shows this. Whether the amplitude (volume information) of the echo component (difference between data 1 and data 2) included in the data 2 reproduced in step ST30 exceeds a preset threshold, for example, by the control unit 210 functioning as a determination unit If not, the state of maintenance of the dialogue environment is judged. Based on the determination result, the control unit 210 controls the drawing unit 260 so that either LED1 or LED2 of the LED alarm is turned on.

  The LED alarm 262B shown in FIG. 7B is the same as the above-described LED alarm 262A in that it includes two types of LEDs, but the LED alarm 262A in that the determination result of the maintenance status of the interactive environment is displayed as a level. And different. That is, the LED alarm 262B adjusts the brightness of the LED 1 (“OK” display LED) indicating that the echo occurrence state is suppressed to a level at which the dialogue can be started, and that the dialogue environment needs to be maintained. By doing so, LED3 (LED of "NO" display) shown in multiple levels is provided. In this case, the control unit 210 sets a threshold value for each of a plurality of levels in advance, and the LED 3 changes the volume of the echo component based on the volume information of the echo component included in the data 2 reproduced in step ST30. The drawing unit 260 is controlled so as to have a corresponding luminance. When the control unit 210 also functions as a determination unit, the control unit 210 determines the level of maintenance of the conversation environment depending on which threshold the amplitude of the echo component included in the data 2 reproduced in step ST30 exceeds. Determination is made (step ST40). Based on the determination result, the control unit 210 selects one of the LED alarms LED1 and LED3, and when selecting the LED3, the drawing unit turns on the LED3 with a level of luminance according to the determination result. 260 is controlled.

  The LED alarm 262C shown in FIG. 7C includes the same two types of LEDs 1 and 2 as the LED alarm 262A, and one or more LED groups (LED4) for displaying the level of the determination result of the maintenance status of the interactive environment. Is provided. That is, the LED alarm 262C includes LED1 ("OK" display LED) indicating that the echo occurrence state is suppressed to a level at which the dialog can be started, and LED2 ("NO" indicating that the dialog environment needs to be maintained. "LED"), and one or more LED groups (LED4) that are turned on according to the necessity of maintenance of the interactive environment. In this case, the control unit 210 sets a threshold value for each of a plurality of levels in advance, and based on the volume information of the echo component included in the data 2 reproduced in step ST30, the LED1, LED2, and LED4 of the LED alarm 262C. Among these, the drawing unit 260 is controlled so as to turn on the LED corresponding to the volume of the echo component. Further, when the control unit 210 also functions as a determination unit, the control unit 210 determines the maintenance level of the interactive environment depending on which threshold the sound amplitude based on the data 2 reproduced in step ST30 exceeds. (Step ST40). Based on the determination result, the controller 210 selects any one of the LED1, LED2, and LED4 of the LED alarm 262C, and when selecting LED4, draws the LED at a level corresponding to the determination result. The unit 260 is controlled.

  As described above, according to the present invention, it is possible to confirm in advance the echo generated in the conversation environment of the other party's dialogue person in the conversation environment of the other party's own conversation in the conversation environment of the other party. It becomes possible. For this reason, it is easy to take measures for eliminating echoes generated in the conversation environment of the other party's dialog, particularly echoes that cannot be removed by the echo canceling function of each information terminal. In addition, the echo canceling work allows the conversation person to confirm the echo occurrence state in advance without being connected to the conversation environment of the partner conversation person who may cause a problem related to the echo.

  From the above description of the present invention, it is apparent that the present invention can be modified in various ways. Such modifications cannot be construed as departing from the spirit and scope of the invention, and modifications obvious to one skilled in the art are intended to be included within the scope of the following claims.

  DESCRIPTION OF SYMBOLS 10 ... Network (transmission means) 20, 20A, 20B ... Conference terminal (information terminal), 30A, 31A ... Dialogue, 30B, 31B ... Opposite talker, 51, 51A, 51B ... Speaker, 52, 52A, 52B ... Microphone, 210 ... Control unit (control unit, determination unit) 230 ... Recording unit (recording unit), 240 ... Echo canceling circuit, 260 ... Drawing unit, 261 ... Liquid crystal monitor (display unit), 262, 262A, 262B, 262C ... LED alarm (display means).

Claims (10)

In a two-way interactive system that enables transmission and reception of electronic data including at least audio data via a predetermined transmission means, in order for the interlocutor to confirm the echo occurrence status in the interactive environment where the information terminal is installed The interactive environment reproduction method of
Storing the first test sound data in the recording means of the information terminal as a test sound source recorded in an interactive environment in which the information terminal is installed;
While reproducing the sound based on the first test sound data via the speaker of the own information terminal, the second test sound data captured via the microphone of the own information terminal is stored as environmental data in the recording means. Store and
An interactive environment reproduction method for reproducing an echo occurrence state in an interactive environment in which the information terminal is installed by reproducing a sound based on the second test sound data through the speaker. The interactive environment reproduction method according to claim 1, wherein the echo component included in the second test sound data is visually displayed using predetermined display means as information indicating the reproduced echo occurrence state. Determining the degree of the reproduced echo occurrence status based on the volume information of the echo component,
3. The interactive environment reproduction method according to claim 2, wherein the judgment result of the echo occurrence state is visually displayed according to a preset judgment level by using a previous period display means. The interactive environment reproduction method according to claim 1, wherein the information terminal has at least an echo canceling function. The first test sound data is electronic data stored in advance in recording means of another information terminal connected to the predetermined transmission means, and is electronic data obtained via the predetermined transmission means. The interactive environment reproduction method according to claim 1, wherein the interactive environment is reproduced. The interactive environment reproduction method according to any one of claims 1 to 4, wherein the first test sound data is electronic data captured through a microphone of the information terminal. The computer program for performing the reproduction method of the interactive environment as described in any one of Claims 1-6. A computer-readable recording medium on which the computer program according to claim 7 is recorded. Control means for executing the interactive environment reproduction method according to any one of claims 1 to 6,
The recording means;
A display means for visually displaying an echo component included in the second test sound data stored in the recording means. Determination means for determining the degree of echo occurrence status reproduced by the control means based on volume information of the echo component;
The apparatus according to claim 9, wherein the display unit visually displays the determination result of the determination unit according to a predetermined determination level.

Images