JP2010204260A - Interactive device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To detect the distance between an interacting device and an operator by utilizing a voice input means and a voice output means, which are originally equipped for interactive processing. <P>SOLUTION: A receiving terminal 20 includes a microphone 207 for inputting voice, and a speaker 208 for outputting voice. Based on noise information which is generated in surroundings, and which is obtained by the microphone 207, false noise for detecting distance is output via the speaker 208. Reflective sound information including a corresponding amplitude or frequency, by reflective sound of the false noise from an object, which is input via the microphone 207, is obtained. Based on the obtained reflective sound information, predetermined calculation processing is performed, and distance to a visitor M is detected by presuming that the object is the visitor M. Based on the detection result, receiving processing by interaction with the visitor M is started. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an interactive device that can be operated by an operator using a voice interactive method.

  For example, an interactive device that can be operated by an operator in an interactive manner, such as a reception device that performs a reception work for a visitor to a building, has been known. In such an interactive device, the presence / absence of the operator within a predetermined distance range is used as a trigger for the start / end of processing, the speech recognition accuracy of the operator's utterance content is improved from the device, etc. It is preferable that the distance to the operator can be accurately detected without contact.

  For such non-contact distance detection, for example, the prior art described in Patent Document 1 is known. In this prior art, an ultrasonic pulse is generated and output to an object (object), and a reflected wave (echo pulse) on the detection object is detected. Then, by calculating the transmission time of the ultrasonic pulse, the distance to the object is detected based on the transmission time.

JP 2005-351897 A

  However, when the distance detection method using ultrasonic waves as in the above-described conventional technique is applied to the interactive device, there is a problem that it becomes necessary to newly provide a sensor or microphone dedicated to distance detection.

  An object of the present invention is to provide an interactive apparatus that can detect a distance to an operator without newly providing a dedicated sensor or microphone.

  In order to achieve the above object, the first invention is an interactive apparatus that can be operated by an operator in an interactive manner, and includes an audio input means for inputting audio, and an audio output means for outputting audio. Sound acquisition means for acquiring sound information including a corresponding amplitude or frequency by sound input through the sound input means, and the sound acquisition within a predetermined time after the sound input means inputs the sound. On the basis of the sound information acquired by the means, a pseudo sound output means for outputting a pseudo sound for distance detection via the sound output means, and an object of the pseudo sound input via the sound input means Based on the reflected sound, reflected sound acquisition means for acquiring reflected sound information including a corresponding amplitude or frequency, and based on the reflected sound information acquired by the reflected sound acquisition means, a predetermined calculation process is performed, and the object is Said It has distance detection means for detecting the distance to the operator based on the assumption that the user is an author, and dialogue processing control means for starting dialogue processing with the operator based on the detection result of the distance detection means. It is characterized by.

  In the dialogue apparatus of the first invention of the present application, the distance from the operator is detected using sound. That is, sound (so-called noise) generated around the apparatus is input through the sound input unit, and corresponding sound information is acquired by the sound acquisition unit. Then, based on this sound information, the pseudo sound output means outputs the pseudo sound for distance detection via the sound output means. The output pseudo sound propagates toward the object and the reflected sound is input via the sound input means, and the corresponding reflected sound information is acquired by the reflected sound acquisition means. The time from when the pseudo sound is emitted until the reflected sound returns is proportional to the distance from the device to the object, but when there is an operator, the reflection reflected by the operator as the object Sound is input via the voice input means, and the time is proportional to the distance from the device to the operator. Therefore, the distance detection means detects the distance to the operator by estimating that the object is the operator based on the reflected sound information. After the distance detection is completed, the dialogue processing control means starts the dialogue processing with the operator based on the detection result, so that the certain dialogue processing can be performed.

  As described above, in the first invention of the present application, the distance to the operator can be detected using the sound input / output via the voice input means and the voice output means. That is, by utilizing voice input means (such as a microphone) and voice output means (such as a speaker) that are originally provided for interactive processing, other distance detection sensors and dedicated microphones are newly provided. The distance can be detected without any problem.

  At this time, the distance detection is performed without using the pseudo sound based on the sound (so-called noise) generated around the device without the operator realizing that the sound is detected. There is also an effect that can be performed.

  According to a second aspect of the present invention, in the first aspect of the invention, the pseudo-sound output unit includes a pseudo-sound generation unit that performs a predetermined process on the sound information acquired by the sound acquisition unit and generates the corresponding pseudo-sound. Outputs the pseudo sound generated by the pseudo sound generating means.

  As a result, in addition to the distance detection using the sound (so-called noise) generated around the device as it is, the noise within a predetermined range (level range or time range) can be used, or various processing can be applied to the noise. It is possible to use what has been applied. As a result, the variation of sound that can be used for distance detection can be expanded, so that the applicability to various applications can be improved.

  According to a third aspect, in the second aspect, the pseudo sound generating means generates the pseudo sound based on the sound information that exceeds a predetermined threshold level.

  When generating the pseudo sound based on the noise, if the level of the original noise is too small, the level of the output pseudo sound is also small and it is difficult to detect the reflected sound. Therefore, in the third invention of the present application, by generating a pseudo sound only for noise exceeding a predetermined threshold level, it is possible to avoid the inconvenience due to the insufficient level and to perform reliable distance detection. it can.

  According to a fourth aspect, in the third aspect, the pseudo sound generating means generates the pseudo sound based on the sound information in a predetermined time range.

  When generating the pseudo sound based on the sound information, if the level of the original noise is too small, the level of the pseudo sound to be output is also small, and it is difficult to detect the reflected sound. Therefore, in the fourth invention of the present application, the pseudo sound is generated by limiting only to noise in a predetermined time range. This cuts out only the large part of the first level until it is attenuated, such as the sound of closing the door or the sound of placing an object, and then decaying rapidly. It is possible to generate a pseudo sound based on the part. As a result, it is possible to avoid the inconvenience due to the insufficient level as described above, and to perform reliable distance detection.

  According to a fifth aspect of the present invention, in any one of the first to fourth aspects, the pseudo sound is output again after a predetermined period of time has elapsed after the completion of the interactive process based on the control of the interactive process control unit. It has the output control means to control, It is characterized by the above-mentioned.

  When the distance between the operator and the dialogue process is determined, and the dialogue process is completed, it is a while after the dialogue process is completed, the operator who has been in conversation has already moved to another place, and there is no one in the vicinity of the device ( Or there is another possibility that there is another operator). Accordingly, in the fifth aspect of the present invention, in response to this, the output control means performs control so that the output of the pseudo sound is executed again when a predetermined period has elapsed after the end of the dialogue processing. Thereby, the distance detection with respect to the next operator can be performed reliably.

  According to the present invention, it is not necessary to newly provide a dedicated sensor or microphone, and the distance to the operator can be detected.

It is a system configuration figure showing the whole visitor reception system composition in one embodiment of the present invention. It is a functional block diagram showing the function structure of the whole system of a visitor reception system. It is a figure showing an example of the display screen in a display part. It is a functional block diagram which shows the functional structure of a reception terminal. It is a functional block diagram showing the functional structure of DB server. It is explanatory drawing explaining the outline | summary of the procedure until it outputs pseudo noise from a speaker. It is explanatory drawing explaining the outline | summary of the method of detecting the distance to a visitor. It is explanatory drawing explaining the outline | summary of the procedure until it restarts acquisition of noise information. It is a flowchart showing the control procedure performed by the control circuit part of a reception terminal. It is explanatory drawing for demonstrating the modification which produces | generates pseudo noise information limited to the noise information of a predetermined time range.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the present embodiment, the dialogue apparatus of the present invention is applied to a visitor reception system that performs reception work for visitors to buildings, companies, and other buildings, for example.

(A) Basic Configuration of System FIG. 1 is a system configuration diagram showing an overall configuration of a visitor reception system according to the present embodiment.

  In FIG. 1, a visitor reception system 1 is installed near the entrance of a company, for example, and has an acceptance terminal 20 (interactive device) that can be operated by an operator (in this example, a visitor to the company) M in an interactive manner. is doing. The reception terminal 20 is provided with a microphone 207 (voice input means) for inputting voice and a speaker 208 (voice output means) for outputting voice.

The reception terminal 20 communicates with the visitor M (in this example, the reception process by the conversation with the visitor M) and the visitor M using voice (noise, pseudo-noise, reflected sound, etc., which will be described later). Perform distance detection. In this embodiment, as a method for detecting the distance from the reception terminal 20 to the visitor M, a sound for distance detection (pseudo noise described later) is output from the speaker 208, and the pseudo noise is reflected by the visitor M. The time required until the reflected sound is input to the microphone 207 is measured. Then, the distance to the visitor M is detected from the relationship that the required time is proportional to the distance to the visitor M. That is, if the distance to the visitor M is L and the required time is t,
L = c × t / 2 (Formula 1)
(The details will be described later with reference to FIG. 7). Note that c is the speed of sound (about 340 [m / s], but varies depending on the density and pressure of air as a medium).

  The distance to the visitor M can be detected by solving the above (Formula 1). Then, when the detected distance is equal to or less than a predetermined value (corresponding to a distance that can be accepted, for example, 1 [m]), the acceptance process is started (details will be described later).

  As illustrated in FIG. 1, the reception terminal 20 includes a display unit 210, the microphone 207, and the speaker 208. The display unit 210 is composed of, for example, a liquid crystal display. In this example, the display unit 210 is supported by an arm 211 with respect to a base 212 installed horizontally, and the surface direction is obliquely upward so as to be perpendicular to the visitor's line of sight Facing. The microphone 207 is arranged in a substantially arc shape with the tip thereof facing the visitor M side with respect to the base 212.

  Note that the display unit 210 may be configured by a touch panel so that the visitor M can operate the displayed display screen while directly touching the screen.

  FIG. 2 is a functional block diagram showing the functional configuration of the entire system of the visitor reception system 1.

  In FIG. 2, the visitor reception system 1 includes a plurality of (two in this example) provided corresponding to the reception terminal 20, a DB server 10 constituted by a well-known personal computer, and employees of the company. ) An IP telephone 60 and an IP-PBX (Internet Protocol Private Branch Exchange) 50, which is a well-known switching apparatus that performs circuit switching of the plurality of IP telephones 60, all of which are connected via a router 40 Yes.

  The reception terminal 20 includes a terminal main body 20A, and the display unit 210, the microphone 207, and the speaker 208 connected to the terminal main body 20A.

  The microphone 207 converts the input voice into voice information and outputs it to the terminal body 20A. In this embodiment, for example, a voice uttered by the visitor M or noise generated around the reception terminal 20 (for example, an air-conditioning sound, a door-closed sound, a sound of placing an object, a footstep, etc.) Etc.

  The speaker 208 converts the voice signal input from the terminal main body 20A into a notification sound (guidance voice) for the visitor M and a pseudo noise (pseudo sound for details detection) (details will be described later).

  FIG. 3 is a diagram illustrating an example of a display screen in the display unit 210. On this screen, a virtual person IM that performs a reception work, which is generated by a drawing program described later, is displayed together with an office-like background G when a reception process described later is started. In addition, a sentence B (abbreviated as “***” in the drawing) corresponding to the voice uttered from the speaker 208 is also displayed.

  FIG. 4 is a functional block diagram illustrating a functional configuration of the reception terminal 20.

  In FIG. 4, the terminal body 20A of the reception terminal 20 includes a control circuit unit 200, an input / output (I / O) interface 204, a hard disk device (HDD) 205, and a timer 209 that is a time measuring means. Yes.

  The control circuit unit 200 includes a CPU 201, a ROM 202 that stores programs necessary for basic operations of the receiving terminal 20 and setting values for the programs, and a RAM 203 that temporarily stores various data. The CPU 201 controls the overall operation of the reception terminal 20 according to programs stored in the ROM 202 and the HDD 205.

  The CPU 201, the hard disk device 205, the timer 209, the display unit 210, the microphone 207, the speaker 208, and a network (NW) card 206 are connected to the I / O interface 204. ing.

  The HDD 205 includes a plurality of storage areas including a language model storage area 252, a dictionary storage area 253, and a program storage area 256.

  In the language model storage area 252, acceptable sentence patterns to be used for recognition of utterances by the visitor M are created in advance according to various situations assumed in the dialogue between the reception terminal 20 and the visitor M. And stored as a language model.

  The dictionary storage area 253 includes a word dictionary used for speech recognition together with the language model, a visitor dictionary used as appropriate for speech recognition for identifying the identity of the visitor M together with the language model and word dictionary, and the like. , Remembered.

  In the program storage area 256, for example, a plurality of programs for controlling various operations of the reception terminal 20 are stored. Examples of the stored program include a system program that controls basic operations of the receiving terminal 20, a communication program that controls communication with the DB server 10, a drawing program that generates an image to be displayed on the display unit 210, and the like described above. Voice recognition program for executing voice recognition, DB collation program for accessing and collating database of DB server 10, voice synthesis program, dialogue control program, telephone connection program for connection between IP telephone 60 and IP-PBX 50 And a distance detection program for controlling the distance detection described above.

  Although not shown, the HDD 205 also stores a well-known acoustic model generally used in voice recognition processing, setting values used in various processing, and the like. Although not described in detail, the acoustic model is a statistical model of the acoustic features of speech. For example, for each vowel and consonant, a phoneme corresponding to the acoustic feature (for example, frequency characteristics) It is expressed by.

  The NW card 206 is connected to the router 40 and is an expansion card for enabling data transmission / reception with the DB server 10 or the like.

  FIG. 5 is a functional block diagram illustrating a functional configuration of the DB server 10.

  As shown in FIG. 5, the DB server 10 includes a CPU 101, a ROM 102 and a RAM 103 connected to the CPU 101, an input / output (I / O) interface 104 connected to the CPU 101, and an I / O interface 104. A mouse controller 106, a key controller 107, a video controller 108, a communication device 109, and a hard disk device (HDD) 150 are connected to each other.

  The ROM 102 stores various programs including the BIOS for operating the DB server 10. The RAM 103 temporarily stores various data. The CPU 101 governs overall control of the DB server 10 according to programs stored in the ROM 102 and an HDD 150 described later.

  A mouse 116, a keyboard 117, and a display 118 are connected to the mouse controller 106, the key controller 107, and the video controller 108, respectively. The communication device 109 is connected to the router 40 and can exchange data with an external device such as the reception terminal 20.

  The HDD 150 includes a plurality of storage areas including a visitor reservation database (DB) storage area 151 for storing visitor information, an employee database (DB) storage area 155 for storing employee information, and a program storage area 156.

  The program storage area 156 stores various programs for causing the DB server 10 to execute various processes such as a system program and a communication program. For example, those programs stored in a CD-ROM are installed via a CD-ROM drive (not shown) and stored in the program storage area 156. Alternatively, a program downloaded from outside the system via an appropriate network may be stored.

(B) Flow until Start of Reception Processing The greatest feature of the present embodiment configured as described above is that the pseudo noise for distance detection is transmitted to the speaker 208 based on noise information corresponding to the noise input via the microphone 207. Output via the microphone 207, detecting the distance to the visitor M based on the reflected sound information corresponding to the reflected sound of the pseudo noise from the visitor M, and the detected distance is a predetermined value. The reception process is started when the following occurs. Hereinafter, the details will be described in order with reference to FIGS. 6 and 7.

  FIG. 6 is an explanatory diagram for explaining an outline of the procedure until the pseudo noise is output from the speaker 208.

  FIG. 6A schematically shows a procedure for generating pseudo noise from noise input to the microphone 207. As shown in FIG. 6A, when noise (in this example, the sound of closing the door 30 installed at a predetermined location in the company) is generated around the reception terminal 20, this noise propagates and the microphone Input to 207, noise information (sound information) including the corresponding amplitude or frequency is acquired. At this time, it is confirmed whether or not the acquired noise information exceeds a predetermined threshold level (for example, it may be confirmed by converting to power by short-time Fourier transform). If the acquired noise information exceeds the threshold level (power is high), distance detection pseudo noise (pseudo sound) is generated based on the noise information.

  If the acquired noise information does not exceed the threshold level (power is small), it is difficult to detect the reflected sound of the pseudo noise described later. Noise information is acquired again without being used for noise generation. Thus, it is limited to noise information that exceeds the threshold level (high power), in other words, noise information that exceeds the threshold level is cut out from the noise information to generate the pseudo noise. It is used for.

  FIG. 6B schematically shows a state in which pseudo noise is output from the speaker 208. As shown in FIG. 6B, the pseudo noise for distance detection generated as described above is output from the speaker 208. This pseudo noise is a sound similar to the noise generated in FIG. 6A (in the door 30) (or may be a processed sound). Also, the timer 209 (see FIG. 4) is started almost simultaneously with the output of the pseudo noise. Thereby, after the pseudo noise is output from the speaker 208, the pseudo noise is reflected to the visitor M, and the reflected sound (= the reflected sound of the pseudo noise at the visitor M. Hereinafter, simply referred to as “reflected sound”). Measurement (measurement) of a required time (hereinafter simply referred to as “required time”) until it is input to the microphone 207 is started.

  FIG. 7 is an explanatory diagram for explaining the outline of the method for detecting the distance to the visitor M. FIG.

  When the pseudo noise is output from the speaker 208 as described above, the pseudo noise is propagated to a predetermined distance range (distance range in which propagation is possible, which varies depending on power). At this time, if there is a visitor M within the range, the pseudo noise is reflected by the visitor M as shown in FIG. 7, and the reflected sound is propagated and input to the microphone 207, and the corresponding reflected sound. Information is acquired. When the reflected sound is input to the microphone 207 in this way, the measurement of the required time performed by the timer 209 ends. That is, the measured value of the timer 209 at this time is the required time.

  Here, since the pseudo noise and the reflected sound thereof are both sound waves, they propagate between the reception terminal 20 and the visitor M at the speed of sound. The required time is a round-trip propagation time in which the pseudo noise and its reflected sound, that is, a sound wave, reciprocate between the reception terminal 20 and the visitor M (more specifically, a pseudo-range between the speaker 208 and the visitor M). The total time of the propagation time of the noise and the propagation time of the reflected sound between the visitor M and the microphone 207). That is, the product of the sound speed and half of the required time (= corresponding to the one-way propagation time) is the distance from the reception terminal 20 to the visitor M. For this reason, the distance from the reception terminal 20 to the visitor M can be detected (calculated) by solving the above (Formula 1) (see FIG. 1).

For example, if the sound speed is 346.5 [m / s] and the measured value of the timer 209 (= the above required time) is 2.0 [msec], the distance L to the visitor M is
L = 346.5 × 2.0 × 10 ⁻³ /2=346.5×10 ⁻³ [m] ≈35 [cm]
It becomes.

  When the distance L detected as described above is equal to or less than a predetermined value (corresponding to a distance that can be accepted, for example, 1 [m]), the acceptance process is started.

  In the case of the distance detection as described above, in this example, the acquisition of the reflected sound information is not started until a predetermined minimum sound wave receiving time elapses from the start of the timer measurement. The minimum sound wave reception time means that the pseudo noise output from the speaker 208 is not directly reflected by the visitor M and is directly input to the microphone 207 (= the so-called pseudo noise around the speaker 207 from the speaker 208). Time). For example, if the distance between the speaker 208 and the microphone 207 is 30 [cm], the minimum sound wave receiving time is 1.73 [msec]. The reflected sound is not input to the microphone 207 until the measurement time of the timer 209 has passed the minimum sound wave reception time. Therefore, by waiting without starting the acquisition of the reflected sound information until the minimum sound wave receiving time elapses, unnecessary sound (pseudo-noise around the above) input to the microphone 207 can be reduced (step of FIG. 9 described later). It can be excluded from the object of confirmation of whether or not the reflected sound is input (performed in S80).

  Further, when a predetermined maximum sound wave receiving time has elapsed from the start of the timer measurement, the acquisition of the reflected sound information is terminated, and the acquisition of noise information is started again. The maximum sound wave reception time is that the pseudo-noise output from the speaker 208 is reflected by the visitor M who is at the maximum distance that allows reception processing by the reception terminal 20, and the reflected sound is input to the microphone 207. It is the time required until. For example, when the maximum distance is 100 [cm], the maximum sound wave receiving time is 5.77 [msec]. After the maximum sound wave receiving time elapses, the reflected sound input to the microphone 207 is reflected by an object (not necessarily the visitor M) existing at a position farther than the maximum distance. When the measurement time of the timer 209 exceeds the maximum sound wave reception time, the acquisition of the reflected sound information is terminated, and the reflected sound is reflected by an unnecessary reflected sound, that is, an object existing at a distance exceeding the maximum distance. Reflected sound information acquired from the reflected sound can be excluded from distance detection targets (performed in step S100 in FIG. 9 described later).

(C) Flow from the start of reception processing to restarting acquisition of noise information When reception processing is started as described above, a predetermined voice (guidance voice. For example, “Welcome. In addition, a predetermined display screen (for example, the one shown in FIG. 3 described above) is displayed on the display unit 210. When the visitor M speaks to the reception terminal 20 in response to the voice and display, the corresponding voice is input by the microphone 207. In this way, the reception operation by the interactive method is performed by the visitor M (with reference to the display screen of the display unit 210).

  In addition, when the reception process is started in this way (when the reception process is being performed), the acquisition of the noise information illustrated in FIG. 6A is not resumed (or as illustrated in FIG. 6A). Thus, although the noise information is acquired, the pseudo noise is not output as shown in FIG. 6B). That is, during the reception process, the microphone 207 and the speaker 208 previously used for detecting the distance to the visitor M are used for the reception process (dialogue with the visitor M).

  FIGS. 8A to 8C show a state after the above reception process is completed. When the reception process is completed as shown in FIG. 8A, the visitor M moves away from the vicinity of the reception terminal 20 and moves to another place, and no one is in the vicinity of the reception terminal 20 (FIG. 8). (B)). That is, the microphone 207 and the speaker 208 are not used for the reception process (dialogue with the visitor M) after a while after the reception process is completed. Then, when a predetermined period (for example, 10 seconds) elapses after the reception process is completed, the acquisition of the noise information is resumed (or the above-described noise information is acquired as shown in FIG. 8C). However, the output of pseudo noise is resumed from the state where pseudo noise is not output). Thus, the state returns to the state of FIG.

(D) Control Procedure FIG. 9 is a flowchart showing a control procedure executed by the control circuit unit 200 of the receiving terminal 20 in order to realize the contents described above. The processing shown in this flow is in accordance with a program group for visitor reception processing (the aforementioned system program, drawing program, voice recognition program, dialogue control program, distance detection program, etc.) stored in the program storage area 256 of the HDD 205. The CPU 201 executes.

  In FIG. 9, for example, this flow is started when the reception terminal 20 is turned on (“START” position). First, in step S10, a predetermined initialization process is executed.

  In step S20, the noise information including the corresponding amplitude or frequency is acquired from the sound (noise) input via the microphone 207 and the I / O interface 204 (function as sound acquisition means).

  Thereafter, in step S30, it is determined whether or not the level of the noise information acquired in step S20 has exceeded a predetermined threshold level. If the noise information does not exceed the threshold level, the determination is not satisfied and the routine returns to step S20 and the same procedure is repeated. If the noise information exceeds the threshold level, the determination is satisfied and the routine goes to Step S40.

  In step S40, predetermined processing is performed on noise information exceeding a predetermined threshold level, and corresponding pseudo noise is generated.

  Then, the process proceeds to step S50, and the generated pseudo noise is output via the I / O interface 204 and the speaker 208 (function as pseudo sound output means). After step S50, the process proceeds to step S55, and the output of the generated pseudo noise is stopped.

  Thereafter, in step S60, a control signal is output to the timer 209 via the I / O interface 204 to start the timer 209. As a result, the pseudo-noise output in step S50 is reflected on the object (visitor M when visitor M is present), and the reflected sound is input to microphone 207 in step S80 described later. Measurement of the required time (time measurement) is started.

  Then, the process proceeds to step S70, and based on the measurement time of the timer 209, it is determined whether or not the measurement time has passed the aforementioned minimum sound wave reception time. Until the minimum sound wave receiving time elapses, the determination is not satisfied and the loop stands by. When the minimum sound wave receiving time elapses, the determination is satisfied, and the process proceeds to step S80.

  In step S <b> 80, it is determined whether or not a reflected sound from the object is input via the microphone 207 and the I / O interface 204. This determination may be performed by a known method such as comparing the power spectrum of the pseudo noise and the sound input via the microphone 207 and the I / O interface 204. If no reflected sound is input, the determination is not satisfied and the routine goes to Step S85.

  In step S85, based on the measurement time of the timer 209 already started in step S60, it is determined whether or not the above-described maximum sound wave reception time has elapsed since the start of time measurement. If the maximum sound wave receiving time has not elapsed, the determination is not satisfied and the routine returns to step S80 to repeat the same procedure. If the maximum sound wave receiving time has elapsed, the determination is satisfied, the process returns to step S20, and the same procedure is repeated.

  On the other hand, if the reflected sound is input in step S80, the determination in step S80 is satisfied and the process proceeds to step S90.

  In step S90, the reflected sound information including the corresponding amplitude or frequency is acquired from the reflected sound input via the microphone 207 and the I / O interface 204 in step S80.

  In step S100, based on the reflected sound information acquired in step S90 and the measurement time of the timer 209 already started in step S60, a predetermined calculation process (in this example, the above-described diagram) 1 and the method using (Expression 1) described above with reference to FIG. 7 are performed to detect the distance to the object (distance to the visitor M when there is a visitor M) (function as distance detection means) .

  Thereafter, in step S110, based on the distance detection result in step S100, it is determined whether or not the distance to the object is equal to or less than a predetermined value (for example, 1 [m]). If the distance to the object is greater than the predetermined value, the determination is not satisfied, and it is assumed that the visitor M does not exist (or the visitor M exists but is too far for the reception process). (Considering) Returning to step S20, the same procedure is repeated. If the distance to the object is less than or equal to the predetermined value, the determination is satisfied, and it is assumed that the visitor M exists within a distance that can be accepted, and the process proceeds to step S120.

  In step S120, a predetermined application program stored in the program storage area 256 of the HDD 205 is read, and the reception process is started by starting the application.

  Then, the process proceeds to step S130, and it is determined whether or not the reception process started in step S120 has been completed. Until the acceptance process is completed, the determination is not satisfied and the system waits in a loop. When the acceptance process is completed, the determination is satisfied, and the process proceeds to step S140 (at this time, the timer 209 starts timing for step S140 described later). .

  In step S140, it is determined whether or not a predetermined period (for example, 10 seconds) has elapsed (for example, based on the time measured by the timer 209) after the reception process is completed. Until the predetermined period elapses, the determination is not satisfied and the loop waits. When the predetermined period elapses, the determination is satisfied, the process returns to step S20, and the same procedure is repeated. As a result, the above-described flow is repeatedly executed continuously at a predetermined time interval (for example, every 2 seconds) until the receiving terminal 20 is turned on or until a predetermined end operation is performed. .

  In the above, Step S30 and Step S40 function as the pseudo sound generation means described in each claim, Step S80 and Step S90 function as the reflected sound acquisition means, and Step S120 functions as the dialog processing control means. To do.

  In addition, after the reception process is started in step S120, the period in which the determination in step S130 is not satisfied and the loop is waiting, in other words, the period in which the reception process is performed does not proceed to step S140 and does not move to step S140. The flow does not end. That is, the acquisition of the noise information is not performed again during the period in which the reception process is performed.

  In addition, when the determination in step S140 is satisfied after the reception process ends, in other words, the flow in FIG. 9 ends when a predetermined period (for example, 10 seconds) elapses. That is, the flow is started again from the “START” position, and the process proceeds from step S10 to step S20, and the acquisition of the noise information is executed again. As a result, step S140 functions as an output control unit that performs control so that pseudo noise is output again after a predetermined period of time has elapsed after the reception process is completed.

  As described above, in the reception terminal 20 according to the present embodiment, the distance to the visitor M is detected using the sound input / output via the microphone 207 and the speaker 208. That is, when noise (for example, a door closing sound) generated around the reception terminal 20 is input via the microphone 207, corresponding noise information is acquired (see step S20), and based on the acquired noise information. Then, pseudo noise for distance detection is output through the speaker 208 (see step S50). Then, when the output pseudo noise propagates and is reflected by the visitor M, the reflected sound is input via the microphone 207, and the corresponding reflected sound information is acquired (see step S90). And based on the acquired reflected sound information, the distance to the visitor M is detected (refer step S100). If the detected distance is equal to or smaller than the predetermined value, the reception process is started (see step S120), so that a reliable reception process can be performed for the visitor M.

  As a result, according to the reception terminal 20 of the present embodiment, the distance to the visitor M can be detected using the sound input / output via the microphone 207 and the speaker 208. That is, by using the microphone 207 and the speaker 208 that are originally provided for the reception process, distance detection can be performed without newly providing a separate distance detection sensor, a dedicated microphone, or the like. .

  At this time, the visitor M can realize that the sound is detected by using pseudo noise (sound similar to noise generated in the surroundings) based on noise information for distance detection. There is also an effect that distance detection can be performed.

  In the present embodiment, in particular, predetermined processing is performed on the noise information, corresponding pseudo noise is generated (see step S40), and the pseudo noise is output via the speaker 208 (see step S50). As a result, in addition to the distance detection using the noise information as it is, the noise information having a predetermined range (level range or time range) can be used (see a modification of (1) described later), or the noise information can be used. What gave various processes can be used (refer the modification of below-mentioned (2)). As a result, the variation of sound that can be used for distance detection can be expanded, so that the applicability to various applications can be improved.

  Here, when the pseudo noise is generated based on the noise information, if the level of the original noise is too small, the level of the pseudo noise to be output is also small, and it is difficult to detect the reflected sound. Therefore, in the present embodiment, pseudo noise is generated based on the noise information that exceeds a predetermined threshold level (for example, power is high) (see step S30). Thereby, as described above, inconvenience due to insufficient level of pseudo noise to be output can be avoided, and reliable distance detection can be performed.

  In addition, when the reception process is started after the distance is detected and the distance to the visitor M is determined, the visitor M should be stably operated by the interactive method. Corresponding to this, particularly in the present embodiment, the pseudo-noise is not output again after the acceptance process is started (see step S130). Thereby, it is possible to avoid waste of repeating the output of pseudo noise again during the stable operation as described above.

  Furthermore, when the reception process is performed after the distance to the visitor M is determined and the reception process is completed, the visitor M who has been in conversation has already moved to another place, and the reception terminal There is a high possibility that there is no one in the vicinity of 20 (or there is another visitor M). Corresponding to this, particularly in the present embodiment, when a predetermined period (for example, 10 seconds) elapses after the reception process ends, the acquisition of noise information is executed again (see step S140). Therefore, when a predetermined period elapses after the reception process is completed, the distance detection for the next visitor M is ensured by outputting the pseudo noise again (ending the flow and starting the flow again). Can be executed.

  The present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit and technical idea of the present invention. Hereinafter, such modifications will be described in order.

(1) When generating pseudo-noise limited to noise information in a predetermined time range In the above embodiment, in order to avoid inconvenience due to insufficient level of pseudo-noise to be output, a predetermined threshold level is exceeded. Although pseudo-noise was generated only for noise information (high power), the present invention is not limited to this. That is, the pseudo noise may be generated limited to noise information in a predetermined time range (for example, first 1 [msec]).

  The control procedure executed by the control circuit unit 200 of the receiving terminal 20 of the present modification may be almost the same as that shown in FIG. However, in step S30, a range of predetermined time T as shown in FIG. 10 (for example, first 1 [msec]) from noise information acquired in step S20 above a predetermined threshold level. To extract (cut out) noise information in terms of time.

  In step S40, the corresponding pseudo noise is generated based on the noise information in the predetermined time range extracted in step S30 as described above.

  According to this modified example, when the pseudo noise is generated, the acquired noise information is not used as it is, but the pseudo noise is generated only in a predetermined time range (for example, first 1 [msec]). To do. This cuts out only the large part of the first level of the noise that suddenly attenuates, such as the sound of closing the door and the sound of placing objects, until it attenuates. Pseudo noise can be generated based on the portion. As a result, as in the above-described embodiment, it is possible to avoid inconvenience due to insufficient level of the pseudo noise to be output, and perform reliable distance detection.

(2) When generating pseudo-noise after performing modulation processing In the above, pseudo-noise is generated by limiting to noise information in a predetermined range (noise information exceeding a threshold level, noise information in a time range) However, it is not limited to this. In other words, pseudo noise may be generated by performing modulation processing (for example, amplitude modulation or frequency modulation) on the noise information. In the control procedure executed by the control circuit unit 200 of the receiving terminal 20 of this modification, step S30 in FIG. 9 is omitted. In step S40 in FIG. 9, the noise information acquired in step S20 is modulated (for example, amplitude modulation) to generate corresponding pseudo noise (function as pseudo sound generation means). Subsequent steps S50 to S140 are the same as those in FIG.

  In this modification, by performing a modulation process on the acquired noise information, pseudo noise amplified to an appropriate level (for example, five times) with respect to the noise level input to the microphone 207 is output via the speaker 208. Therefore, reliable distance detection can be performed. In this case, the original noise information is not limited to a predetermined range such as a predetermined threshold level (the above embodiment) or a predetermined time range (modified example of (1) above). There is also. Alternatively, it is possible to generate pseudo noise by changing to a frequency that is convenient for detection by the above modulation, and reliable distance detection can also be performed.

(3) Others In the above, the voice input unit is configured by one microphone 207, but is not limited thereto, and may be configured by a plurality of (for example, two) microphones (so-called array type microphone device). . With such a configuration, noise generated around the reception terminal 20 can be input by each of the plurality of microphones, and noise information can be acquired well (with high sensitivity). In addition, the noise generation direction can be specified by controlling the directivity of each of the plurality of microphones. As a result, the microphone sensitivity in the noise generation direction is increased, or the pseudo-noise output from the speaker is set in a mode corresponding to the noise generation direction, so that the visitor M can be made less noticeable. Get the effect.

  In the above, as the predetermined calculation process, the time required from the output of pseudo noise to the input of the reflected sound is measured, and this time required is proportional to the distance to the visitor M. The distance from the relationship (see above (formula 1)) to the visitor M was detected. However, the present invention is not limited to this, and as a predetermined calculation process, the distance to the visitor M may be detected from the phase difference between the output pseudo noise and the input reflected sound. Even in this case, the same effect as described above can be obtained.

  In addition, in the above, the arrow shown in each figure of FIG. 4, FIG. 5, etc. shows an example of the flow of a signal, and does not limit the flow direction of a signal.

  In addition, the flowchart shown in FIG. 9 does not limit the present invention to the procedure shown in the above-described flow, and the procedure may be added / deleted or the order may be changed without departing from the spirit and technical idea of the invention. Good.

  In addition to those already described above, the methods according to the above-described embodiments and modifications may be used in appropriate combination.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

20 Reception terminal (dialogue device)
201 CPU
207 Microphone (voice input means)
208 Speaker (Audio output means)
M Visitor (operator)

Claims (5)

An interactive device that an operator can operate in an interactive manner,
Voice input means for inputting voice;
Audio output means for outputting audio;
Sound acquisition means for acquiring sound information including a corresponding amplitude or frequency by sound input through the voice input means;
A pseudo sound output means for outputting a pseudo sound for distance detection via the sound output means based on the sound information acquired by the sound acquisition means within a predetermined time after the sound input means inputs the sound. When,
Reflected sound acquisition means for acquiring reflected sound information including a corresponding amplitude or frequency from the reflected sound of the pseudo sound object input through the voice input means;
Based on the reflected sound information acquired by the reflected sound acquisition means, a predetermined calculation process, a distance detection means for detecting the distance to the operator by assuming that the object is the operator;
A dialogue processing control means for starting dialogue processing with the operator based on a detection result of the distance detection means. Performing a predetermined process on the sound information acquired by the sound acquisition unit, and generating a corresponding pseudo sound,
The pseudo sound output means includes
The interactive apparatus according to claim 1, wherein the pseudo sound generated by the pseudo sound generating means is output. The pseudo sound generating means includes
The interactive apparatus according to claim 2, wherein the pseudo sound is generated based on sound information that exceeds a predetermined threshold level. The pseudo sound generating means includes
The interactive apparatus according to claim 3, wherein the pseudo sound is generated based on the sound information in a predetermined time range. 2. An output control unit that controls to output a pseudo sound again after a predetermined period of time has elapsed after the completion of the interactive processing based on the control of the interactive processing control unit. Item 5. The interactive device according to any one of items 4 to 5.

Images