JP2005182140A - Order receiving device and order receiving method for restaurant - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide the order receiving device and method of a restaurant for recognizing an order with a voice from a customer, and for receiving the order of food and drink. <P>SOLUTION: This order receiving device is provided with a data processing part 100 for intensively managing order receiving conditions, a customer terminal 200 set in the provision place of food and drink to a customer, a store terminal 300 set in the management place of a restaurant and a kitchen display part 400 set in the kitchen of the restaurant. A microphone 220 of the customer terminal 200 inputs a voice signal related with the order of the food and drink of the customer, and a data processing part 100 specifies order content by voice recognition processing based on the voice signal, and updates an order reception management file, and makes a customer terminal display part 210 of the customer terminal 200, a store terminal display part 310 of the store terminal 300 and the kitchen display part 400 display the order reception result based on the updated order reception management file. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an order receiving apparatus and an order receiving method for a restaurant that receives an order from a customer via an electrical signal.

  Conventionally, orders for food and drink from customers in restaurants such as restaurants have been made through manual operations such as waitresses. That is, when a customer visits a restaurant and a restaurant employee recognizes the customer's visit, the waitress receives an order at the customer's location, and the restaurant starts cooking the food and drink associated with the order. .

However, the above-described conventional method for ordering foods and drinks has a problem in that labor costs are required for restaurants because orders are made by hand.
Moreover, there is a problem that it takes time and troublesome for customers to provide food and drink.
For example, if a restaurant employee or the like does not recognize that the customer has visited the store, the customer must wait until the waitress receives the order, and the order takes time. Even when the restaurant employee recognizes that the customer has visited the store, when the restaurant is crowded, the waitress cannot respond to the customer who visited the store, so it takes time to place an order.
Furthermore, when a customer desires an additional order, the waitress must be called up to a table or the like, which is cumbersome and sometimes hesitates to place an order.
Furthermore, since the conventional order receiving method requires manual labor, there is often a problem that the food and drink ordered by the customer do not match the food and drink actually provided.

  This invention is made | formed in view of this situation, The objective is to provide the order receiving apparatus and order receiving method of the restaurant which recognizes the order by the voice from a customer, and receives food and drink.

  In order to achieve the above object, a first aspect of the present invention is an order receiving apparatus for a restaurant that provides a food by receiving a customer's order by voice, and is arranged at a place where the food and drink is provided in the restaurant. A first display means configured to display a list of a plurality of foods and drinks that can be provided; a microphone that is disposed at a food and drink provision location of the restaurant and that collects customer orders by voice; and the food and drinks The second display means arranged at the cooking place of the store and voice recognition based on the voice collected by the microphone, and based on the voice recognition result, the customer out of the plurality of food and drink Voice recognition means for specifying food and drink related to the order, and control means for causing the first display means, the second display means, and the third display means to display the food and drink specified by the voice recognition means. It has.

  Preferably, it further includes a third display means disposed in a management place for managing the order status of the food and drink at the restaurant, and the control means includes the food and drink specified by the voice recognition means, The first display means, the second display means, and the third display means are displayed.

  Preferably, when there are a plurality of places where food and drink are provided, the first display means and the microphone are arranged at each provision place, and the control means is configured to provide the voice recognition means for each provision place. Manage the food and drink identified by.

  A second aspect of the present invention for achieving the above object is an order receiving apparatus of a restaurant that provides food and drink by receiving a customer's order by voice, and is arranged at a place where the food and drink is provided in the restaurant. A first display means for displaying a list of a plurality of foods and drinks that can be provided, and at least two microphones having different directivities disposed in the food and drink provision location of the restaurant. The microphone selection means for selecting one microphone based on the sound pressure collected by the microphone, the second display means disposed at the cooking place of the restaurant, Voice recognition is performed based on the voice collected by one microphone selected by the microphone selection means, and the customer order is selected from the plurality of foods and drinks based on the voice recognition result. A speech recognition means for identifying the food that the food that has been specified by the speech recognition means, first display means, and control means for displaying on the second display unit and third display means.

  A third aspect of the present invention for achieving the above object is a restaurant ordering method for providing food and drink by receiving a customer order by voice, and is arranged at the food and beverage provision place of the restaurant. A list of a plurality of foods and drinks that can be provided is displayed on the first display unit that is provided, and a customer order by voice is collected by a microphone disposed at the food and drink provision location of the restaurant, Voice recognition is performed based on the voice collected by the microphone, and based on the result of the voice recognition, the food and drink related to the customer's order is identified from the plurality of food and drink, and the identified food and drink And the first display unit and the second display unit disposed at the cooking place of the restaurant.

  According to the restaurant order receiving apparatus according to the first aspect of the present invention, the first display means displays a list of a plurality of foods and drinks that can be provided and provided at a food and drink provision place of the restaurant. The microphone is disposed at a place where food and drink is provided in the restaurant, collects customer orders by voice, the second display means is disposed at a cooking place in the restaurant, and the voice recognition means is , Performing voice recognition based on the voice collected by the microphone, identifying food and drink related to the customer's order from the plurality of food and drink based on the result of the voice recognition, the control means, Since the food and drink specified by the voice recognition means are displayed on the first display means and the second display means, the customer orders by voice are centrally managed by the control means, and the food and drink related to the order can be quickly and reliably Can be provided.

  According to the present invention, since an order by voice from a customer is recognized to receive a food and drink, there is an advantage that a quick order can be received and at the same time the labor cost for the order can be reduced. Further, from the viewpoint of the customer side, the order can be simply made by voice as before, and the ordered food and drink are provided at an early stage, so that the satisfaction is improved.

First Embodiment Hereinafter, the telephone device (two-way communication device) as the microphone selection means of the present invention used in the third embodiment will be described in detail.
FIGS. 1A to 1C are configuration diagrams showing an example to which the communication device of the present invention is applied.
As illustrated in FIG. 1A, communication devices 1A and 1B are installed in two remote conference rooms 901 and 902, respectively, and these communication devices 1A and 1B are connected by a telephone line 920. Yes.
As illustrated in FIG. 1B, in the two conference rooms 901 and 902, the two-way communication devices 1A and 1B are placed on the tables 911 and 912, respectively. However, in FIG. 1B, only the two-way communication device 1A in the conference room 901 is illustrated for simplification of illustration. The same applies to the two-way communication device 1B in the conference room 902. FIG. 2 shows an external perspective view of the two-way communication devices 1A and 1B.
As illustrated in FIG. 1C, a plurality (six in this embodiment) of conference participants A1 to A6 are located around the two-way communication devices 1A and 1B, respectively. However, in FIG. 1C, only conference participants around the two-way communication device 1A in the conference room 901 are illustrated for simplification. The arrangement of conference participants located around the two-way communication device 1B in the other conference room 902 is the same.

The two-way communication device of the present invention can respond by voice via the telephone line 920 between two conference rooms 901 and 902, for example.
Normally, a conversation via the telephone line 920 is performed by one speaker and one speaker, that is, one-on-one, but the two-way communication device of the present invention uses one telephone line 920. A plurality of conference participants A1 to A6 can talk with each other. Although details will be described later, the number of speakers at the same time (same time zone) is limited to one each other in order to avoid voice congestion.
Since the two-way communication device of the present invention is intended for voice (call), only voice is transmitted via the telephone line 920. In other words, a large amount of image data as in the video conference system is not transmitted. Furthermore, since the two-way communication device of the present invention compresses and transmits conference participants' calls, the transmission burden on the telephone line 920 is light.

Configuration of Interactive Communication Device The configuration of an interactive communication device as an embodiment of the present invention will be described with reference to FIGS.
FIG. 2 is a perspective view of a two-way communication device as an embodiment of the present invention.
FIG. 3 is a sectional view of the two-way communication apparatus illustrated in FIG.
4 is a plan view of the microphone / electronic circuit housing portion of the two-way communication apparatus illustrated in FIG. 1, and is a plan view taken along line X-XY in FIG.

As illustrated in FIG. 2, the two-way communication device 1 includes an upper cover 11, a sound reflection plate 12, a connecting member 13, a speaker housing portion 14, and an operation portion 15.
As illustrated in FIG. 3, the speaker housing 14 includes a sound reflecting surface 14 a, a bottom surface 14 b, and an upper sound output opening 14 c. The reception / reproduction speaker 16 is accommodated in a lumen 14d which is a space surrounded by the sound reflection surface 14a and the bottom surface 14b. The sound reflecting plate 12 is positioned above the speaker housing portion 14, and the speaker housing portion 14 and the sound reflecting plate 12 are connected by a connecting member 13.

  A constraining member 17 passes through the connecting member 13, and the constraining member 17 is between the constraining member / lower fixing portion 14 e on the bottom surface 14 b of the speaker housing portion 14 and the constraining member fixing portion 12 b of the sound reflecting plate 12. Is restrained. However, the restraining member 17 only penetrates the restraining member / penetrating portion 14 f of the speaker housing portion 14. The reason why the restraining member 17 penetrates the restraining member / penetrating portion 14f and is not restrained here is that the speaker housing portion 14 vibrates due to the operation of the speaker 16, but the vibration is restrained around the upper sound output opening 14c. This is to prevent it from happening.

The voice spoken by the speaker in the speaker partner conference room is removed from the upper sound output opening 14c through the reception / reproduction speaker 16, and is transmitted between the sound reflecting surface 12a of the sound reflecting plate 12 and the sound reflecting surface 14a of the speaker accommodating portion 14. It spreads in all directions of 360 degrees around the axis CC along the defined space.
As illustrated, the cross section of the sound reflecting surface 12a of the sound reflecting plate 12 depicts a gentle trumpet arc. The cross section of the sound reflecting surface 12a has a cross-sectional shape illustrated over 360 degrees (omnidirectional) about the axis CC.
Similarly, as illustrated in the cross section of the sound reflection surface 14a of the speaker housing portion 14, a gentle convex surface is drawn. The cross section of the sound reflecting surface 14a also has the illustrated cross sectional shape over 360 degrees (omnidirectional) about the axis CC.

The sound S emitted from the reception / reproduction speaker 16 passes through the upper sound output opening 14c, passes through a sound output space having a trumpet-shaped cross section defined by the sound reflection surface 12a and the sound reflection surface 14a, and the voice response device 1 Along the surface of the placed table 911, the sound spreads in all directions 360 degrees around the axis C-C, and is heard at a volume equal to all conference participants A1 to A6. In the present embodiment, the surface of the table 911 is also used as part of the sound propagation means.
The diffusion state of the sound S output from the receiving / reproducing speaker 16 is shown by arrows.

The sound reflecting plate 12 supports the printed circuit board 21.
On the printed circuit board 21, as illustrated in a plan view in FIG. 4, the microphones MC <b> 1 to MC <b> 6, the light emitting diodes LED <b> 1 to 6, the microprocessor 23, the codec (CODEC) 24, and the first digital signal Various electronic circuits such as a processor (DSP 1) DSP 25, a second digital signal processor (DSP 2) DSP 26, an A / D converter block 27, a D / A converter block 28, and an amplifier block 29 are mounted on the sound reflector. Reference numeral 12 also functions as a member that supports the microphone / electronic circuit housing portion 2.

  The printed circuit board 21 has a damper 18 that absorbs vibration from the reception / reproduction speaker 16 so that vibration from the reception / reproduction speaker 16 is transmitted to the sound reflector 12 and does not enter the microphones MC1 to MC6. It is attached. The damper 18 includes a screw and a cushioning material such as an anti-vibration rubber inserted between the screw and the printed board 21, and the cushioning material is screwed to the printed board 21 with a screw. That is, the vibration transmitted from the reception / reproduction speaker 16 to the printed circuit board 21 is absorbed by the buffer material. Thereby, the microphones MC1 to MC6 are not affected by the sound from the speaker 16.

As shown in FIG. 4, six microphones MC <b> 1 to MC <b> 6 are located radially from the central axis C of the printed circuit board 21 at equal intervals (60 degrees in this embodiment). Each microphone is a unidirectional microphone. Its characteristics will be described later.
Each of the microphones MC1 to MC6 is swingably supported by a first microphone support member 22a and a second microphone support member 22b, both of which are flexible or elastic (in order to simplify the illustration, the microphones Only the first microphone support member 22a and the second microphone support member 22b in the MC1 portion are illustrated), and is not affected by the vibration from the reception / reproduction speaker 16 by the damper 18 using the above-described cushioning material. In addition to the countermeasures, the first microphone support member 22a and the second microphone support member 22b having flexibility or elasticity absorb the vibration of the printed circuit board 21 that is vibrated by the vibration from the reception / reproduction speaker 16, and reproduce the reception. The noise of the receiving / reproducing speaker 16 is avoided so as not to be affected by the vibration of the speaker 16.

As illustrated in FIG. 3, the reception / reproduction speaker 16 is oriented perpendicularly to the central axis CC of the plane on which the microphones MC1 to MC6 are located (in the present embodiment, it is directed upward) With the arrangement of the reception / reproduction speaker 16 and the six microphones MC1 to MC6, the distance between the reception / reproduction speaker 16 and each of the microphones MC1 to MC6 is equal. The sound reaches the microphones MC1 to MC6 with almost the same volume and phase. However, due to the configuration of the sound reflecting surface 12a of the sound reflecting plate 12 and the sound reflecting surface 14a of the speaker housing portion 14, the sound of the receiving and reproducing speaker 16 is not directly input to the microphones MC1 to MC6. In addition, as described above, by using the damper 18 using the buffer material, the first microphone support member 22a and the second microphone support member 22b having flexibility or elasticity, the reception / reproduction speaker 16 is provided. The influence of vibration is reduced.
As shown in FIG. 1C, the conference participants A1 to A6 are usually almost equal to the vicinity of the microphones MC1 to MC6 arranged at intervals of 60 degrees in the direction of 360 degrees around the voice response device 1. Located at intervals.

Light- emitting diodes Light-emitting diodes LED1 to 6 are arranged in the vicinity of the microphones MC1 to MC6 as means for reporting that a speaker to be described later has been determined.
The light emitting diodes LED1 to 6 are provided so as to be visible from all the conference participants A1 to A6 even when the upper cover 11 is attached. Therefore, the upper cover 11 is provided with a transparent window so that the light emitting states of the light emitting diodes LED1 to LED6 can be visually recognized. Of course, the upper cover 11 may be provided with openings in the portions of the light emitting diodes LEDs 1 to 6, but a light transmitting window is preferable from the viewpoint of dust prevention to the microphone / electronic circuit housing portion 2.

The printed circuit board 21 includes a first digital signal processor (DSP1) 25, a second digital signal processor (DSP2) 26, and various electronic circuits 27 to 29 for performing various signal processing described later. It is arranged in a space other than the part where MC6 is located.
In the present embodiment, the DSP 25 is used as signal processing means for performing processing such as filter processing and microphone selection processing together with various electronic circuits 27 to 29, and the DSP 26 is used as an echo canceller.

FIG. 5 is a schematic configuration diagram of the microprocessor 23, the codec 24, the DSP 25, the DSP 26, the A / D converter block 27, the D / A converter block 28, the amplifier block 29, and other various electronic circuits.
The microprocessor 23 performs overall control processing of the microphone / electronic circuit housing unit 2. The codec 24 compresses and encodes the voice to be transmitted to the other party conference room.
The DSP 25 performs various signal processing described below, such as filter processing and microphone selection processing.
The DSP 26 functions as an echo canceller.
In FIG. 5, four A / D converters 271 to 274 are illustrated as an example of the A / D converter block 27, and two D / A converters are illustrated as an example of the D / A converter block 28. The converters 281 to 282 are illustrated, and two amplifiers 291 to 292 are illustrated as an example of the amplifier block 29.
In addition, as the microphone / electronic circuit housing portion 2, various circuits such as a power supply circuit are mounted on the printed circuit board 21.

In FIG. 4, a pair of microphones MC1-MC4: MC2-MC5: MC3-M6 arranged in a straight line at symmetrical (or opposite) positions with respect to the central axis C of the printed circuit board 21 each have two channels. The analog signals are input to A / D converters 271 to 273 that convert digital signals. In this embodiment, one A / D converter converts a 2-channel analog input signal into a digital signal. Therefore, the detection signals of two (one pair) microphones, for example, microphones MC1 and MC4, which are positioned on a straight line across the central axis C, are input to one A / D converter and converted into digital signals. Yes. Further, in this embodiment, in order to identify the speaker of the voice to be sent to the other party's conference room, the difference between the two microphones positioned on a straight line, the volume of the voice, etc. are referred to. When the signals of two microphones located on the line are input to the same A / D converter, the conversion timing is also substantially the same, and there is little timing error when taking the difference between the audio outputs of the two microphones. There are advantages such as being easy.
The A / D converters 271 to 274 can also be configured as A / D converters 271 to 274 with a variable gain amplification function.
The collected sound signals of the microphones MC1 to MC6 converted by the A / D converters 271 to 274 are input to the DSP 25, and various signal processing described later is performed.
As one of the processing results of the DSP 25, the result of selecting one of the microphones MC1 to MC6 is output to the light emitting diodes LED1 to LED6.

The processing result of the DSP 25 is output to the DSP 26 and an echo cancellation process is performed. The DSP 26 includes, for example, an echo cancellation transmission processing unit and an echo cancellation reception unit.
The processing result of the DSP 26 is converted into an analog signal by the D / A converters 281 to 282. The output from the D / A converter 281 is encoded by the codec 24 as necessary, and output to the line-out of the telephone line 920 (FIG. 1 (A)) via the amplifier 291 to the partner conference room. The sound is output as a sound through the reception / reproduction speaker 16 of the installed voice response device 1.
Voice from the two-way communication device 1 installed in the other party's conference room is input via the line-in of the telephone line 920 (FIG. 1A), converted into a digital signal by the A / D converter 274, The signal is input to the DSP 26 and used for echo cancellation processing. In addition, the voice from the two-way communication device 1 installed in the other party's conference room is applied to the speaker 16 through a route (not shown) and output as sound.
The output from the D / A converter 282 is output as a sound from the reception / reproduction speaker 16 of the bidirectional communication apparatus 1 via the amplifier 292. In other words, in addition to the voice of the speaker selected in the other party's conference room from the reception / reproduction speaker 16 described above, the conference participants A1 to A6 also use the reception / reproduction speaker 16 for the voice uttered by the speaker in the conference room. Can be heard through.

Microphones MC1 to MC6
FIG. 6 is a graph showing the characteristics of the microphones MC1 to MC6.
Each unidirectional characteristic microphone changes its frequency characteristic and level characteristic as illustrated in FIG. 6 depending on the arrival angle of sound from the speaker to the microphone. The plurality of curves indicate directivity when the frequency of the sound collection signal is 100 Hz, 150 Hz, 200 Hz, 300 Hz, 400 Hz, 500 Hz, 700 Hz, 1000 Hz, 1500 Hz, 2000 Hz, 3000 Hz, 4000 Hz, 5000 Hz, and 7000 Hz. However, in order to simplify the illustration, FIG. 6 typically illustrates the directivity for 150 Hz, 500 Hz, 1500 Hz, 3000 Hz, and 7000 Hz.

7A to 7D are graphs showing the analysis results of the position of the sound source and the sound collection level of the microphone. A speaker is placed at a predetermined distance, for example, a distance of 1.5 meters, from the two-way communication device 1. The result of performing fast Fourier transform (FFT) on the sound collected by each microphone at regular time intervals is shown. The X axis represents frequency, the Y axis represents signal level, and the Z axis represents time.
When the microphone having directivity shown in FIG. 6 is used, strong directivity is shown in front of the microphone. In the present embodiment, using such characteristics, the DSP 25 performs a microphone selection process.

When a non-directional microphone is used instead of a directional microphone as in the present invention, since all sounds around the microphone are collected, the S / N between the voice of the speaker and the ambient noise is confused. Good sound cannot be collected. In order to avoid this, in the present invention, S / N with surrounding noise is improved by collecting sound with one directional microphone.
Furthermore, a microphone array using a plurality of omnidirectional microphones can be used as a method for obtaining the directivity of the microphone. However, in such a method, the time axis (phase) of a plurality of signals is complicated, and thus complicated. Since processing is required, it takes time and response is low, and the apparatus configuration is complicated. That is, the DSP signal processing system also requires complicated signal processing. The present invention solves such a problem by using the directional microphone illustrated in FIG.
Further, in order to synthesize a microphone array signal and use it as a directional sound pickup microphone, there is a disadvantage that the outer shape is restricted by the pass frequency characteristic and the outer shape becomes large. The present invention also solves this problem.

Effects of the device configuration of the communication device The communication device configured as described above exhibits the following advantages.
(1) The positional relationship between the even number of microphones MC1 to MC6 arranged radially at equal angles and at equal intervals and the reception / reproduction speaker 16 is constant, and the distance from the reception / reproduction speaker 16 is very short. The level at which the output sound returns directly to the microphones MC1 to MC6 via the conference room (room) environment is overwhelmingly dominant. Therefore, the characteristics (signal level (intensity), frequency characteristics (f characteristic), phase) that the sound reaches from the speaker 16 to the microphones MC1 to MC6 are always the same. That is, there is an advantage that the two-way communication device 1 in the embodiment of the present invention always has the same transfer function.
(2) Therefore, there is no change in the transfer function when the output of the microphone sent to the other party's conference room is switched when the speakers are different, and there is no need to adjust the gain of the microphone system every time the microphone is switched. Have advantages. In other words, there is an advantage that once the adjustment is made at the time of manufacturing the interactive communication apparatus, it is not necessary to redo the adjustment.
(3) Even if the microphones are switched when the speakers are different for the same reason as described above, only one echo canceller (DSP 26) is required. The DSP is expensive, and it is not necessary to arrange a plurality of DSPs on the printed circuit board 21 on which various members are mounted and the space is small, and the space for arranging the DSPs on the printed circuit board 21 may be small. As a result, the printed circuit board 21, and thus the communication device of the present invention can be made smaller.
(4) As described above, since the transfer function between the reception and reproduction speaker 16 and the microphones MC1 to MC6 is constant, for example, the sensitivity difference adjustment of the microphone itself having ± 3 dB can be performed by the microphone unit of the two-way communication device alone. There is an advantage. Details of the sensitivity difference adjustment will be described later.
(5) The table on which the two-way communication device 1 is mounted normally uses a round table or a polygonal table. However, a single reception / reproduction speaker 16 in the two-way communication device 11 can provide sound of equal quality. A loudspeaker system that is uniformly distributed (diffused) in all directions of 360 degrees around the axis C has become possible.
(6) The sound emitted from the receiving / reproducing speaker 16 is transmitted to the table surface of the round table (boundary effect), effectively and evenly delivering high-quality sound to the conference participants, and facing the ceiling direction of the conference room There is an advantage that the sound and phase on the side are canceled and become a small sound, and there are few reflected sounds from the ceiling direction to the conference participants, and as a result, a clear sound is distributed to the participants.
(7) Since the sound emitted from the reception / reproduction speaker 16 reaches all the microphones MC1 to MC6 arranged radially and at equal intervals at the same angle at the same volume at the same time, it is determined whether the sound is the voice of the speaker or the received voice. It becomes easy. As a result, erroneous determination of microphone selection processing is reduced. Details thereof will be described later.
(8) Even number, for example, six microphones are arranged at equal angles radially and at equal intervals, and a pair of opposing microphones are arranged in a straight line, so that level comparison for direction detection can be easily performed.
(9) By the damper 18, the microphone support member 22, and the like, it is possible to reduce the influence of the vibration due to the sound of the reception and reproduction speaker 16 on the sound collection of the microphones MC1 to MC6.
(10) As illustrated in FIG. 3, structurally, the sound of the reception / reproduction speaker 16 does not directly propagate to the microphones MC1 to MC6. Therefore, in the two-way communication apparatus 1, the influence of noise from the reception / reproduction speaker 16 is small.

The communication device 1 described with reference to FIGS. 2 to 3 has the reception reproduction speaker 16 disposed in the lower portion and the microphones MC1 to MC6 (and related electronic circuits) disposed in the upper portion. The positions of 16 and microphones MC1-MC6 (and associated electronic circuitry) can also be turned upside down as illustrated in FIG. Even in such a case, the above-described effects are exhibited.

  The number of microphones is not limited to six, and any number of microphones such as four, eight, etc. may be arranged in a straight line (in the same direction) with a plurality of pairs of axes C radially and equally spaced at the same angle. They are arranged in a straight line like MC1 and MC4. The reason why the two microphones MC1 and MC4 are arranged to face each other is to select a microphone and specify a speaker.

Signal Processing Contents Hereinafter, processing contents mainly performed by the first digital signal processor (DSP) 25 will be described.
FIG. 9 is a diagram illustrating an outline of processing performed by the DSP 25. The outline is described below.

(1) Measurement of ambient noise As an initial operation, preferably, ambient noise where the two-way communication device 1 is installed is measured.
The two-way communication device 1 can be used in various environments (conference rooms). In order to improve the performance of the two-way communication device 1 in order to ensure the accuracy of selection of the microphone, in the present invention, noise in the surrounding environment where the two-way communication device 1 is installed is measured in the initial stage. It is possible to eliminate the influence from the signal collected by the microphone.
Of course, when the two-way communication apparatus 1 is repeatedly used in the same conference room, noise measurement is performed in advance, and this process can be omitted when the noise state does not change.
Note that noise measurement can also be performed in a normal state.
Details of the noise measurement will be described later.

(2) Selection of Chairperson For example, when the two-way communication device 1 is used for a two-way conference, it is beneficial to have a chairman who manages the proceedings in each conference room. Therefore, as one aspect of the present invention, the chairperson is set from the operation unit 15 of the interactive communication device 1 in the initial stage of using the interactive communication device 1. As a chairperson setting method, for example, the first microphone MC1 located in the vicinity of the operation unit 15 is used as a chairperson microphone. Of course, the chairman's microphone can be arbitrary.
Note that this processing can be omitted when the chairperson who repeatedly uses the interactive communication device 1 is the same. Or you may decide the microphone of the position where a chairperson sits beforehand. In that case, there is no need to select a chairman each time.
Of course, the selection of the chair is not limited to the initial state, and can be performed at any timing.
Details of the chairperson selection will be described later.

(3) Microphone sensitivity difference adjustment As an initial operation, preferably, the gain or attenuation unit of the amplification unit that amplifies the signals of the microphones MC1 to MC6 so that the acoustic coupling between the reception reproduction speaker 16 and the microphones MC1 to MC6 is equal. Automatically adjust the attenuation value.
The sensitivity difference adjustment will be described later.

Various processes exemplified below are performed as normal processes.
(4) Microphone selection / switching process When a plurality of conference participants make a call at the same time in one conference room, voices are mixed and difficult for the conference participants A1 to A6 in the other conference room. Therefore, in the present invention, in principle, one person is allowed to talk at a time. For this reason, the DSP 25 performs microphone selection / switching processing.
As a result, only the call from the selected microphone is transmitted to the voice response device 1 in the other party conference room via the telephone line 920 and output from the speaker. Of course, as described with reference to FIG. 5, the LED in the vicinity of the selected speaker's microphone is turned on, and the selected speaker's voice is also output from the speaker of the interactive communication device 1 in the room. Can hear and recognize who is an authorized speaker.
The purpose of this processing is to select a signal from a unidirectional microphone facing the speaker and send a signal having a good S / N to the other party as a transmission signal.
(5) Display of the selected microphone Lights so that all the conference participants A1 to A6 can easily recognize which conference participant's microphone is selected and allowed to speak. The corresponding ones of the diodes LEDs 1 to 6 are turned on.
(6) As a background art of the microphone selection process described above, or in order to accurately perform the microphone selection process, various signal processes exemplified below are performed.
(A) Band separation and level conversion processing of microphone collected signal (b) Start / end determination processing of speech
To be used as a trigger to start selecting the microphone signal that faces the speaker direction.
(C) Speaker direction microphone detection processing
To analyze the collected sound signal of each microphone and determine the microphone used by the speaker.
(D) Speaker direction microphone switching timing determination processing, and microphone signal selection switching processing facing the detected speaker
An instruction to switch to the microphone selected from the above processing result is given. (E) Measurement of floor noise during normal operation

Measurement of floor (environment) noise This process is divided into an initial process and a normal process immediately after the two-way communication device is turned on.
This process is performed under the following exemplary preconditions.

Immediately after turning on the power of the interactive communication apparatus 1, the DSP 25 performs the following noise measurement described with reference to FIGS.
The initial processing of the DSP 25 immediately after turning on the power of the two-way communication device 1 is to measure the floor noise and the reference signal level, and based on the difference between them, a guideline of the effective distance between the speaker and the present system and the speech start / end determination threshold level. To set up.
The level value peak-held by the sound pressure level detection unit in the DSP 25 is read at a constant time interval, for example, 10 mSec, and an average value of unit time values is calculated and used as floor noise. Then, the DSP 25 determines a threshold value for a speech start detection level and a speech end detection level based on the measured floor noise level.

FIG. 10, Process 1: Test Level Measurement The DSP 25 outputs a test tone to the line-in terminal of the reception signal system illustrated in FIG. 5 according to the process illustrated in FIG. The sound is collected at ~ MC6, and the average value is obtained using the signal as a speech start reference level.

FIG. 11, Process 2: Noise measurement 1
In accordance with the process illustrated in FIG. 11, the DSP 25 collects the level of the collected sound signal from each of the microphones MC1 to MC6 as a floor noise level for a predetermined time and obtains an average value.

FIG. 12, Process 3: Effective distance trial DSP 25 compares the speech start reference level with the floor noise level according to the process illustrated in FIG. And the effective distance between the speaker who works well in the two-way communication device 1 and the two-way communication device 1 is calculated.

As a result of the microphone selection prohibition determination process 3, if the floor noise is larger (higher) than the speech start reference level, the DSP 25 determines that there is a strong noise source in the direction of the microphone, and automatically selects a microphone in that direction. The prohibition is set, and this is displayed, for example, on the light emitting diodes LED1 to 6 or the operation unit 15.

As illustrated in FIG. 13, the threshold value determination DSP 25 compares the speech start reference level and the floor noise level, and determines the threshold values of the speech start and end levels from the difference.

  As far as noise measurement is concerned, the next process is a normal process, so the DSP 25 sets each timer (counter) and prepares for the next process.

The noise normal processing DSP 25 performs noise processing according to the processing shown in FIG. 14 in the normal operation state after the noise measurement during the initial operation of the two-way communication device 1, and each of the six microphones MC1 to MC6. The volume level average value of the selected speaker and the noise level after detection of the end of the speech are measured, and the speech start / end determination threshold level is reset in a fixed time unit.

FIG. 14, Process 1 : The DSP 25 determines branching to Process 2 or Process 3 based on the determination of whether the speech is in progress or the end of speech.

FIG. 14, Process 2 : Speaker Level Measurement The DSP 25 averages and records the level data for a unit time, for example, 10 seconds, for a plurality of times, for example, 10 times, as a speaker level.
If the utterance ends within the unit time, the time measurement and the utterance level measurement are stopped until a new utterance starts, and the measurement process is resumed after the new utterance is detected.

FIG. 14, Process 3 : Floor noise measurement 2
The DSP 25 averages the noise level data for a unit time, for example, 10 seconds from the detection of the end of the speech to the start of the speech, and records the average as a floor noise level a plurality of times, for example, 10 times.
If there is a new message within the unit time, the DSP 25 stops the time measurement and noise measurement on the way, and restarts the measurement process after detecting the end of the new message.

FIG. 14, Process 4 : Threshold Determination 2
The DSP 25 compares the speech level and the floor noise level, and determines the threshold values for the speech start and end levels from the difference.
In addition to this, since the average value of the speaking level of the speaker is obtained, the speaking start and end detection threshold levels specific to the speaking party facing the microphone can be set.

Generation of Various Frequency Component Signals by Filter Processing FIG. 15 is a configuration diagram showing filtering processing performed by the DSP 25 using sound signals collected by a microphone as preprocessing. FIG. 15 shows processing for one microphone (channel (one sound collection signal)).
The collected sound signal of each microphone is processed by an analog low cut filter 101 having a cutoff frequency of 100 Hz, for example, and a filtered audio signal from which a frequency of 100 Hz or less has been removed is output to the A / D converter 102. , Digital high-cut filters 103a to 103e (collectively referred to as “collection signals”) having cut-off frequencies of 7.5 KHz, 4 KHz, 1.5 KHz, 600 Hz, and 250 Hz, respectively. 103), high frequency components are removed (high cut processing). The results of the digital high cut filters 103a to 103e are further subtracted for each filter signal of the adjacent digital high cut filters 103a to 103e in subtractors 104a to 104d (collectively 104).
In the embodiment of the present invention, the digital high cut filters 103a to 103e and the subtractors 104a to 104d are actually processed in the DSP 25. The A / D converter 102 can be realized as one of the A / D converter blocks 27.

  FIG. 16 is a frequency characteristic diagram showing the filter processing result described with reference to FIG. Thus, a plurality of signals having various frequency components are generated from a signal collected by a microphone having one directivity.

The start and end of speech is determined as one of the triggers for starting the band-pass filter processing and microphone signal level conversion processing microphone selection processing. A signal used for this purpose is obtained by the bandpass filter processing and level conversion processing illustrated in FIG. FIG. 17 shows only 1CH during input signal processing of 6 channels (CH) collected by the microphones MC1 to MC6.
The band-pass filter processing and level conversion processing unit in the DSP 25 respectively collects the collected sound signals of the microphones of each channel at 100 to 600 Hz, 200 to 250 Hz, 250 to 600 Hz, 600 to 1500 Hz, 1500 to 4000 Hz, 4000 to 7500 Hz. Band-pass filters 201a to 201a having band-pass characteristics (collectively, band-pass filter block 201), original microphone sound collection signals, and level converters 202a to 202g (for level conversion of the band-pass sound collection signals) Collectively, it has a level conversion block 202).

  Each level conversion unit 202 a to 202 g includes a signal absolute value processing unit 203 and a peak hold processing unit 204. Therefore, as illustrated in the waveform diagram, the signal absolute value processing unit 203 inverts the sign and converts it to a positive signal when a negative signal indicated by a broken line is input. The peak hold processing unit 204 holds the maximum value of the output signal of the signal absolute value processing unit 203. However, in the present embodiment, the held maximum value is somewhat lowered with the passage of time. Of course, the peak hold processing unit 204 can be improved so that the maximum value can be held for a long time by reducing the decrease.

A bandpass filter will be described. The band-pass filter used for the two-way communication device 1 is composed of, for example, a secondary IIR high-cut filter and a microphone signal input stage low-cut filter only.
In the present embodiment, it is utilized that if the signal that has passed through the high-cut filter is subtracted from the signal having a flat frequency characteristic, the rest is substantially equivalent to the signal that has passed through the low-cut filter.
In order to match the frequency-level characteristics, an extra band-pass bandpass filter is required for one band, but the band required by the number of filter stages equal to the number of bands of the required bandpass filter + 1 and the filter coefficient A pass is obtained. The band frequency of the hand pass filter required this time is the following 6 band pass filter per channel (CH) of the microphone signal.

In this method, the calculation program of the above IIR filter in the DSP 25 is only 6CH (channel) × 5 (IIR filter) = 30.
Contrast with the conventional band-pass filter configuration. Assuming that the band-pass filter uses a second-order IIR filter and a 6-band band-pass filter is prepared for each of six microphone signals as in the present invention, in the conventional method, 6 × 6 × 2 = 72. Circuit IIR / filtering is required. This processing requires considerable program processing even with the latest excellent DSP, and affects other processing.
In the embodiment of the present invention, the 100 Hz low cut filter is processed by an analog filter in the input stage. There are five types of cutoff frequencies of the prepared second-order IIR high cut filters: 250 Hz, 600 Hz, 1.5 KHz, 4 KHz, and 7.5 KHz. Of these, the high-cut filter with a cutoff frequency of 7.5 kHz is not necessary because the sampling frequency is actually 16 KHz. Deliberately rotate the phase of the attenuator to reduce the phenomenon.

  FIG. 18 is a flowchart when processing by the DSP 25 is performed according to the configuration illustrated in FIG.

  In the DSP 25 illustrated in FIG. 18, a high-pass filter process is performed as the first stage process, and a subtraction process from the result of the first-stage high-pass filter process is performed as the second stage process. FIG. 16 is an image frequency characteristic diagram of the signal processing result. [X] below shows each processing case in FIG.

First stage [1] The input signal is passed through a 7.5 kHz high cut filter for the whole band pass filter. This filter output signal becomes a bandpass filter output of [100Hz-7.5KHz] by matching the analog low cut of the input.

  [2] Pass the input signal through a 4KHz high cut filter. This filter output signal becomes a bandpass filter output of [100Hz-4KHz] by combining with the input analog low cut filter.

  [3] Pass the input signal through a 1.5 kHz high cut filter. This filter output signal is combined with the input analog low cut filter [100Hz-1.5KHz] is combined with the input analog low cut filter [100Hz-1.5KHz] When combined with the input analog low cut filter [100Hz -1.5KHz] bandpass filter output.

  [4] Pass the input signal through a 600 kHz high cut filter. This filter output signal becomes a bandpass filter output of [100Hz-600Hz] by combining with the input analog low cut filter.

  [5] The input signal is passed through a 250 kHz high cut filter. This filter output signal becomes a bandpass filter output of [100Hz-250Hz] by combining with the input analog low cut filter.

The second stage [1] band pass filter (BPF5 = [4KHz ~ 7.5KHz]) executes the process of filter output [1]-[2] ([100Hz ~ 7.5KHz]-[100Hz ~ 4KHz]) The signal output is [4KHz to 7.5KHz].
[2] The bandpass filter (BPF4 = [1.5KHz to 4KHz]) will perform the above processing when the filter output [2]-[3] ([100Hz to 4KHz]-[100Hz to 1.5KHz]) is executed. Output [1.5KHz ~ 4KHz].
[3] The bandpass filter (BPF3 = [600Hz to 1.5KHz]) performs the above processing when the filter output [3]-[4] ([100Hz to 1.5KHz]-[100Hz to 600Hz]) is executed. Output [600Hz ~ 1.5KHz].
[4] The bandpass filter (BPF2 = [250Hz to 600Hz]) performs the process of filter output [4]-[5] ([100Hz to 600Hz]-[100Hz to 250Hz]). ~ 600Hz]. [5] The bandpass filter (BPF1 = [100 Hz to 250 Hz]) uses the signal [5] as it is as the output signal [5].
[6] The bandpass filter (BPF6 = [100 Hz to 600 Hz]) uses the signal [4] as it is and outputs it as the output signal (4).
The bandpass filter output required by the above processing in the DSP 25 is obtained.

  The input microphone sound collection signals MIC1 to MIC6 are constantly updated in the DSP 25 as the sound pressure level of the entire band and the sound pressure level of the six bands that have passed through the bandpass filter as shown in Table 5.

In Table 5, for example, L1-1 indicates a peak level when the collected sound signal of the microphone MC1 passes through the first bandpass filter 201a.
The start and end of speech is determined using a microphone sound collection signal that has passed through the 100 Hz to 600 Hz bandpass filter 201a shown in FIG. 17 and whose sound pressure level has been converted by the level converter 202b.

  The conventional band-pass filter is configured by combining a high-pass filter and a low-pass filter for each stage of the band-pass filter. Therefore, a 36-band band-pass filter of the specification used in this embodiment is used. When constructed, 72 circuits of filter processing are required. In contrast, the filter configuration of the embodiment of the present invention is simplified as described above.

Sentence start / end determination processing The first digital signal processor (DSP1) 25, based on the value output from the sound pressure level detector, as shown in FIG. If it rises and exceeds the threshold of the speech start level, it is determined that the speech starts.If the level continues to be higher than the threshold of the start level, the floor noise is determined if the level is lower than the threshold of speech end during speech. The speech end determination time is determined, for example, when it is continued for 0.5 seconds, the speech end is determined.
The start and end of speech is determined based on sound pressure level data (microphone signal level (1)) that has passed through a 100 Hz to 600 Hz bandpass filter whose sound pressure level has been converted by the microphone signal conversion processing unit 202b illustrated in FIG. It is determined that the utterance has started when the threshold level illustrated in FIG. 19 is reached.
In order to avoid malfunction due to frequent microphone switching, the DSP 25 does not detect the next speech start after the speech start determination time, for example, 0.5 seconds.

The microphone selection DSP 25 performs speaker direction detection and automatic selection of a microphone signal facing the speaker in the mutual communication system based on a so-called “star chart method”.
FIG. 20 is a graph illustrating the operation mode of the interactive communication device 1.
FIG. 21 is a flowchart showing normal processing of the interactive communication device 1.

As illustrated in FIG. 20, the two-way communication device 1 performs voice signal monitoring processing according to the collected sound signals from the microphones MC1 to MC6, performs speech start / end determination, performs speech direction determination, and selects a microphone. The result is displayed on the light emitting diodes LED1 to LED6.
The operation will be described below with the DSP 25 in the two-way communication device 1 as a main component with reference to the flowchart of FIG. The overall control of the microphone / electronic circuit housing unit 2 is performed by the microprocessor 23, and the processing of the DSP 25 will be mainly described.

Step 1: Level Conversion Signal Monitoring Signals collected by the microphones MC1 to MC6 are respectively obtained in the band-pass filter block 201 and the level conversion block 202 described with reference to FIGS. Therefore, the DSP 25 constantly monitors seven types of signals for each microphone sound collection signal.
Based on the monitoring result, the DSP 25 proceeds to any one of the speaker direction detection processing 1, the speaker direction detection processing 2, and the speech start / end determination processing.

Step 2: Speech Start / End Determination Processing The DSP 25 determines the start and end of speech according to the method described in detail below with reference to FIG. When the DSP 25 detects the start of speech, the DSP 25 informs the speaker direction determination processing in step 4 of the start of speech.
When the speech start / end determination process in step 2 is performed, when the speech level becomes lower than the speech end level, a speech end determination time (for example, 0.5 second) timer is activated and the speech end determination time and the speech level are When the level is lower than the end level, it is determined that the speech has ended.
If it becomes larger than the speech end level within the speech end determination time, it waits until it becomes smaller than the speech end level again.

Step 3: Speaker Direction Detection Processing The speaker direction detection processing in the DSP 25 is continuously performed by continuously searching for the speaker direction. Thereafter, the data is supplied to the speaker direction determination processing in step 4.

Step 4: Speaker direction microphone switching processing The timing determination processing in the speaker direction microphone switching processing in the DSP 25 has been selected from the results of the processing in step 2 and step 3 and the speaker detection direction at that time. If the speaker direction is different, the microphone selection in step 4 is instructed to select a microphone in a new speaker direction.
However, if the chairman's microphone is set from the operation unit 15 and the chairman's microphone and another conference participant speak at the same time, the chairman's comment is given priority.
At this time, the selected microphone information is displayed on the light emitting diodes LED1 to LED6.

Step 5: Transmission of microphone sound collecting signal In the microphone signal switching process, only the microphone signal selected by the process of Step 4 from the six microphone signals is used as the transmission signal, and the two-way communication device 1 through the telephone line 920. For transmission to the other party's two-way communication device, the data is output to the line-out of the telephone line 920 illustrated in FIG.

Processing for setting a speech start level threshold and a speech end threshold 1: Immediately after turning on the power, the floor noise for a predetermined time, for example, 1 second, of each microphone is measured.
The DSP 25 reads out the peak-held level value of the sound pressure level detection unit at a constant time interval, for example, 10 mSec interval in this embodiment, and calculates an average value of values for a predetermined time, for example, 1 minute to obtain floor noise. And
The DSP 25 determines a speech start detection level (floor noise +9 dB) and a speech end detection level threshold (floor noise +6 dB) based on the measured floor noise level. The DSP 25 thereafter reads the peak-held level value of the sound pressure level detector at regular time intervals.
When it is determined that the speech has ended, the DSP 25 functions as a floor noise measurement, detects the start of speech, and updates the threshold for the detection level of speech end.

  According to this method, since the floor noise level at the position where the microphone is placed is different in this threshold setting, a threshold can be set for each microphone, and erroneous determination in selection of the microphone by the noise source can be prevented.

Process 2: Dealing with ambient noise (large floor noise) rooms Process 2 performs the following as a countermeasure when it is difficult to detect the start and end of speech when the floor level is high in Process 1 and the threshold level is automatically updated. .
The DSP 25 determines a threshold for the detection level of the speech start and the detection level of the speech end based on the predicted floor noise level.
The DSP 25 sets the speech start threshold level to be greater than the speech end threshold level (for example, a difference of 3 dB or more).
The DSP 25 reads the level value peak-held by the sound pressure level detector at regular time intervals.

  According to this method, since the threshold value is the same value for all microphones, the person who is behind the noise source and the person who is not so have the same voice volume and can recognize the start of speech.

Talk start judgment
Process 1 : The output level of the sound pressure level detector corresponding to the six microphones is compared with the threshold value of the speech start level.
When the output level of the sound pressure level detector corresponding to all the microphones exceeds the threshold of the speech start level, the DSP 25 determines that the signal is from the reception / reproduction speaker 16 and does not determine that the speech is started. This is because the distance between the reception / reproduction speaker 16 and all the microphones MC1 to MC6 is the same, so that the sound from the reception / reproduction speaker 16 reaches almost all the microphones MC1 to MC6.

Process 2 : Two unidirectional microphones (with microphones MC1 and MC1) with the directional axes shifted by 180 degrees in the opposite direction at an equal angle of 60 degrees with respect to the six microphones illustrated in FIG. Three sets of MC4, microphones MC2 and MC5, and microphones MC3 and MC6) are used, and the level difference of the microphone signal is used. That is, the following calculation is performed.

The DSP 25 compares the absolute values [1], [2], and [3] with the threshold value of the speech start level, and determines that the speech is started when the threshold value of the speech start level is exceeded.
In the case of this process, since all the absolute values do not become larger than the threshold value of the speech start level as in process 1 (because the sound from the reception / reproduction speaker 16 reaches all the microphones equally), the reception / reproduction speaker 16 It is not necessary to determine whether the sound is from the speaker or from the speaker.

Speaker Direction Detection Processing For detecting the speaker direction, the characteristics of the unidirectional microphone illustrated in FIG. 6 are used. As illustrated in FIG. 6, the frequency characteristics and level characteristics of the unidirectional microphone change depending on the sound arrival angle from the speaker to the microphone. The results are illustrated in FIGS. 7 (A) to (D). FIGS. 7A to 7D show a fast Fourier transform (FFT) at a predetermined time interval for the sound collected by each microphone with a speaker placed at a predetermined distance from the two-way communication device 1, for example, a distance of 1.5 meters. ) Result. The X axis represents frequency, the Y axis represents signal level, and the Z axis represents time. The horizontal line represents the cut-off frequency of the band-pass filter, and the level of the frequency band sandwiched between the lines is the 5-band band pass from the microphone signal level conversion processing described with reference to FIGS.・ Data converted to sound pressure level through the filter.

A determination method applied as an actual process for detecting the direction of the speaker in the two-way communication device 1 as one embodiment of the present invention will be described.
Appropriate weighting processing is performed on the output level of each band-pass filter (0 for 1 dB full span (1 dBFs) step, 0 for 0 dBFs, 3 for -3 dBFs, or vice versa). This weighting step determines the processing resolution.
The above weighting process is executed for each sample clock, and the weighted score of each microphone is added and averaged with a fixed number of samples, and the microphone signal having a small (large) total score is determined as a microphone facing the speaker. To do. Table 7 below is an image of this result.

In this example illustrated in Table 7, the smallest total point is the first microphone MC1, so the DSP 25 determines that there is a sound source in the direction of the first microphone MC1 (there is a speaker). The DSP 25 holds the result in the form of a sound source direction microphone number.
As described above, the DSP 25 performs weighting on the output level of the bandpass filter in the frequency band for each microphone, and ranks the microphone signals in the order of smaller (or larger) scores of the output of each bandbandpass filter. The microphone signal having the first rank in three or more bands is determined as the microphone facing the speaker. Then, the DSP 25 creates a score table as shown in Table 8 below assuming that there is a sound source in the direction of the first microphone MC1 (there is a speaker).

  Actually, the performance of the first microphone MC1 is not necessarily the best in the output of all bandpass filters due to the reflection of sound and the influence of standing waves depending on the characteristics of the room, but the majority in the 5 bands If it is 1st place, it can be determined that there is a sound source in the direction of the first microphone MC1 (there is a speaker). The DSP 25 holds the result in the form of a sound source direction microphone number.

  The DSP 25 sums the output level data of each band band pass filter of each microphone in the form shown in Table 9 below, determines that the microphone signal having a high level is the microphone facing the speaker, and determines the result as the sound source direction microphone number. Hold in the form of.

Talker direction microphone switching timing determination processing When activated by the speech start determination result of step 2 in FIG. 21 and when a new speaker microphone is detected from the speaker direction detection processing result of step 3 and past selection information, The DSP 25 issues a microphone signal switching command to the microphone signal selection switching process in step 5 and notifies the light emitting diodes LED1 to 6 that the speaker microphone has been switched. Informs that the communication device 1 has responded.

In order to eliminate the influence of reflected sound and standing waves in a room with high reverberation, the DSP 25 prohibits the activation of a new microphone selection command if the speech end determination time (for example, 0.5 seconds) has not elapsed after switching the microphone.
In this embodiment, two microphone selection switching timings are prepared from the result of the microphone signal level conversion process in step 1 in FIG. 21 and the result of the speaker direction detection process in step 3.

First method : When it is possible to clearly determine the start of speech When speech from the direction of the selected microphone has ended and there is a new speech from another direction.
In this case, the DSP 25 starts speaking after all the microphone signal level (1) and the microphone signal level (2) are equal to or lower than the speech end threshold level and more than the speech end determination time (for example, 0.5 seconds). When any microphone signal level (1) is equal to or higher than the speech start threshold level, it is determined that speech has started, and a microphone facing the speaker direction is properly collected based on the information of the microphone number in the sound source direction. The microphone is determined, and the microphone signal selection switching process in step 5 is started.

Second method : When there is a new louder voice from another direction while the voice is continuing In this case, the DSP 25 starts the voice from the start of the voice (when the microphone signal level (1) exceeds the threshold level) and the voice ends. The determination process starts after the determination time (for example, 0.5 seconds) has elapsed. If it is determined that the sound source direction microphone number from the process 3 is changed and is stable before the end of the speech is detected, the DSP 25 is more than the speaker currently selected for the microphone corresponding to the sound source direction microphone number. It is determined that there is a speaker who is speaking loudly, the sound source direction microphone is determined as a valid sound collecting microphone, and the microphone signal selection switching process in step 5 is started.

The microphone signal selection switching processing DSP 25 facing the detected speaker is activated by the command selected and determined by the command from the speaker direction microphone switching timing determination processing in step 4 of FIG.
The microphone signal selection switching process of the DSP 25 is composed of a 6-circuit multiplier and a 6-input adder as illustrated in FIG. In order to select the microphone signal, the DSP 25 sets the channel gain (channel gain: CH Gain) of the multiplier to which the microphone signal to be selected is connected to [1], and the CH gains of the other multipliers to [0]. By doing so, the selected signal of (microphone signal × [1]) and the processing result of (microphone signal × [0]) are added to the adder, and a desired microphone selection signal is obtained at the output.

  When the channel gain is switched between [1] and [0] as described above, there is a possibility that a click sound is generated due to the level difference of the microphone signal to be switched. Therefore, in the two-way communication device 1, as illustrated in FIG. 23, in order to change the change in CH Gain from [1] to [0] and from [0] to [1], for example, By continuously changing and crossing in a time of 10 milliseconds, the generation of a click sound due to the difference in the level of the microphone signal is avoided.

  Further, by setting the maximum channel gain to other than [1], for example, [0.5], the echo cancellation processing operation in the DSP 25 at the subsequent stage can be adjusted.

  As described above, the call device according to the embodiment of the present invention is not affected by noise, and can be effectively applied to a call device such as a conference.

The communication device according to the embodiment of the present invention has the following advantages in terms of structure.
(1) The positional relationship between a plurality of microphones having a single directivity and the reception / reproduction speaker is constant, and furthermore, since the distance is very close, the sound emitted from the reception / reproduction speaker passes through the conference room (room) environment. The level that returns directly to the multiple microphones is overwhelmingly dominant. Therefore, the characteristics (signal level (intensity), frequency characteristics (f characteristic), phase) for sound to reach a plurality of microphones from the receiving / reproducing speaker are always the same. That is, there is an advantage that the transfer function is always the same in the communication device.

  (2) Therefore, there is no change in the transfer function when the microphone is switched, and there is an advantage that it is not necessary to adjust the gain of the microphone system every time the microphone is switched. In other words, there is an advantage that it is not necessary to start over once the adjustment is made at the time of manufacturing the communication device.

  (3) Even if the microphone is switched for the same reason as described above, only one echo canceller configured by a digital signal processor (DSP) may be used. The DSP is expensive, and the space for placing the DSP on a printed circuit board on which various members are mounted and there is little space may be small.

  (4) Since the transfer function between the receiving / reproducing speaker and the plurality of microphones is constant, there is an advantage that the sensitivity difference of the microphone itself having ± 3 dB can be adjusted by the unit alone. (5) The table on which the communication device is mounted normally uses a round table, but a speaker system that evenly distributes sound of equal quality in all directions with one reception / reproduction speaker in the communication device can be realized. became.

  (6) The sound emitted from the receiving / reproducing speaker is transmitted to the table surface (boundary effect), and the sound is effectively and evenly delivered to the conference participants, and the sound on the opposite side to the ceiling of the conference room. The phase is canceled to produce a small sound, and there is an advantage that the conference participant has less reflected sound from the ceiling direction, and as a result, a clear sound is distributed to the participant.

  (7) Since the sound emitted from the reception / reproduction speaker reaches all of the plurality of microphones at the same volume at the same time, it is easy to determine whether the sound is the speaker's voice or the reception voice. As a result, erroneous determination of microphone selection processing is reduced.

  (8) By arranging even number of microphones at equal intervals, level comparison for direction detection can be easily performed.

  (9) Due to a damper using a cushioning material, a microphone support member having flexibility or elasticity, vibration due to the sound of the reception and reproduction speaker that can be transmitted through the printed circuit board on which the microphone is mounted is collected by the microphone. Can reduce the influence.

  (10) The sound of the receiving / reproducing speaker does not directly enter the microphone. Therefore, in this two-way communication device, the influence of noise from the reception / reproduction speaker is small.

The above communication device has the following advantages from the signal processing aspect.
(A) A plurality of unidirectional microphones are arranged radially at equal intervals so that the direction of the sound source can be detected, and the microphone signal is switched to collect (collect) sound with good S / N and clear sound. Can be sent to the other party.
(B) Sound from surrounding speakers can be collected with good S / N and a microphone facing the speaker can be automatically selected.
(C) In the present invention, signal analysis is simplified by dividing a passing voice frequency band as a method of microphone selection processing and comparing levels of the divided frequency bands.
(D) The microphone signal switching processing of the present invention is realized as DSP signal processing, and a plurality of signals are all cross-fade processed so as not to generate a clicking sound at the time of switching.
(E) The microphone selection result can be notified to display means such as a light emitting diode or to the outside. Therefore, for example, it can be used as speaker position information for a television camera.

Second Embodiment Hereinafter, a restaurant order receiving apparatus according to a second embodiment will be described with reference to the accompanying drawings.
A restaurant order receiving device (hereinafter referred to as an order receiving device) according to the present embodiment is a device used in a restaurant that provides food and drink such as a restaurant or a coffee shop, and receives a customer order by voice.
FIG. 24 is a diagram showing an example of the configuration of the order receiving device 40 in the present embodiment.
In FIG. 24, A1 sitting on the table for passenger seat T1 is a restaurant customer, A2 is a manager such as a restaurant owner, and A3 is a cook who cooks according to orders in the restaurant kitchen. is there. As shown in FIG. 24, the order receiving device 40 in this embodiment includes a data processing unit 100, a customer terminal 200, a store terminal 300, and a kitchen display unit 400. Each component is connected by a signal line 900.
Further, the customer terminal 200 is disposed in each of the passenger seat tables T1, T2.

FIG. 25 is a diagram illustrating an example of a system configuration of the order receiving device 40 according to the present embodiment. FIG. 26 is a diagram illustrating an example of a block diagram of the data processing unit 100 of the order receiving device 40.
Hereinafter, each component of the order receiving device 40 will be described with reference to FIGS. 25 and 26.

In the order receiving device 40, as shown in FIG. 25, signals are exchanged between the components via the signal line 900.
As described above, in the restaurant, the number of customer terminals 200 is not limited to one, and when there are a plurality of tables, they are arranged for each table. Each customer terminal 200 is managed as a customer table number by the data processing unit 100.

The data processing unit 100 inputs the audio signal S220 from the microphone 220 of the customer terminal 200 arranged in each table via the signal line 900.
In this embodiment, the audio signal line from the microphone 220 of the customer terminal 200 is an independent signal line (parallel) for each table, and the data processing unit 100 determines the corresponding customer table number according to the input audio signal. Can be recognized. It goes without saying that a common line (serial) can be connected to the customer terminal 200 of each table, and a signal in which the customer table number is superimposed on the voice signal can be transmitted from each customer terminal 200.

  The data processing unit 100 sends a display control signal S100 to the customer terminal display unit 210, the store terminal display unit 310, and the kitchen display unit 400 via the signal line 900.

As shown in FIG. 26, the data processing unit 100 includes a CPU 110 as a control unit, a voice recognition processing unit 120 as a voice recognition unit, a voice recognition memory 130, a food and drink data file 140, and an order management file 150. Have.
The CPU 110 controls the entire data processing of the order receiving device 40. That is, the CPU 110 performs input / output control and timing control with the customer terminal 200, the shop terminal 300, and the kitchen display unit 400, data processing for the voice recognition processing unit 120, the food and drink data file 140, and the order management file 150, and the like. Execute.
Moreover, CPU110 will update the order management file 150, if the food and drink which concerns on an order are specified by the speech recognition process part 120. FIG.
Furthermore, in order to display the order status of food and drink based on the order management file 150, a display control signal S100 is sent to the customer terminal display unit 210, the shop terminal display unit 310, and the kitchen display unit 400. To do.
At that time, a display control signal S100 is independently sent to each of the plurality of customer terminal display units 210, and food and drink are supplied to the customer terminal display unit 210 of the customer terminal 200 of the table where there is no order. Based on the data file 140, a display control signal S100 is transmitted so as to display a list of food and drink data that can be provided (so-called menu).

The voice recognition processing unit 120 performs the voice recognition processing based on the voice signal S220 related to the order of the customer A1 input from the microphone 220 by the data processing unit 100, thereby specifying the food or drink related to the order.
Specifically, first, when an audio signal S220 related to an order is input from the microphone 220, the input audio signal is analyzed, and an acoustic feature amount is calculated from an acoustic model stored in the audio recognition memory 130, as will be described later. Extract (acoustic features). That is, an acoustic feature is extracted for each input sound signal for each basic sound unit used for speech recognition, that is, for each unit of small human pronunciation (phoneme) such as a consonant or a vowel.

  Furthermore, the speech recognition processing unit 120 refers to the acoustic features for each phoneme extracted from the speech signal with the recognition dictionary stored in the speech recognition memory 130, and inputs the speech signal input from the character string data to be recognized. The candidate closest to each phoneme is defined as a speech recognition result (character string data). That is, since the character string data corresponding to the acoustic features in phonemes is described in the recognition dictionary, the acoustic features extracted from the speech signal S220 are compared with the acoustic features described in the recognition dictionary. The character string data corresponding to the closest acoustic feature is selected.

  As described above, when the voice signal S220 input from the microphone 220 is converted into character string data, the voice recognition processing unit 120 identifies the food and drink related to the order contents based on the converted character string data, and the food and drink data file With reference to 140, an order code corresponding to the specified food or drink is output to CPU 110. At that time, based on the converted character string data, data on the quantity of food and drink related to the order is output to the CPU 110 together with the order code.

The voice recognition memory 130 stores the above-described acoustic model and recognition dictionary.
In the acoustic model, a small unit (phoneme) of human pronunciation is described by an acoustic feature, and it is possible to refer to an acoustic feature corresponding to the phoneme unit of an audio signal. This acoustic feature is statistical acoustic feature information of phonemes obtained from the voices of many speakers.
Character string data for speech recognition is described in the recognition dictionary, and it is possible to refer to character string data corresponding to acoustic features in units of phonemes.

27A and 27B are diagrams illustrating examples of the food and drink data file 140 and the order management file 150. FIG. 27A shows an example of the food and drink data file 140, and FIG. 27B shows an example of the order management file 150. , Respectively.
As shown in FIG. 27 (A), the food / drink data file 140 is stored in association with food / beverage that can be provided by a restaurant and an order court corresponding to the food / drink. For example, the order code corresponding to “ramen” is “0x02”.
The food and drink data file 140 is preferably configured to be accessible for updating from the outside because the food and drink that can be provided by the restaurant may be changed from time to time depending on the procurement status of food and the like.

The order management file 150 is a file for the CPU 110 to manage the customer table number (customer table number) arranged in the restaurant and the order status from each table.
In the example shown in FIG. 27B, orders for “ramen” and “gyoza” with order codes “0x02” and “0x03” are received one by one from the table of customer table number 1, respectively.
The file contents of the order management file 150 are updated by the CPU 110 based on the order contents supplied from the voice recognition processing unit 120 to the CPU 110, that is, the order code and quantity data. In addition, when the provision of the ordered food and drink is completed, the order code recorded in the order management file 150 needs to be deleted by an employee of the restaurant or the like. Configure to be accessible.

As shown in FIG. 25, the customer terminal 200 includes a customer terminal display unit 210 and a microphone 220 as first display means.
Based on the display control signal S100 supplied from the data processing unit 100, the customer terminal display unit 210 displays a list of foods and drinks that can be provided at the restaurant and the order status.
The microphone 220 collects the customer's voice order and supplies it to the data processing unit 100 as an audio signal S220.

The store terminal 300 includes a store terminal display unit 310 as a third display means. The shop terminal display unit 310 displays the order status from the customer based on the display control signal S100 supplied from the data processing unit 100.
The kitchen display section 400 displays the order status from the customer based on the display control signal S100 supplied from the data processing section 100 as the second display means.

Heretofore, each component of the order receiving device 40 has been described.
Next, the operation of the order receiving device 40 will be described with reference to FIGS.
In the following description of the operation, as shown in FIG. 24, it is assumed that the customer A1 comes to a restaurant equipped with the order receiving device 40 and orders “Please give ramen and dumplings” at the table T1.
In addition, in FIG. 24, in the initial screen of the customer terminal display unit 210 of the customer terminal 200 arranged in each table, based on the display control signal S100 from the data processing unit 100, the food and drink data that can be provided is displayed. A list (so-called menu) is displayed, and the customer A1 selects and orders food and drink from a list of food and drink data that can be provided.

First, an order by voice of “Please give ramen and dumplings” of customer A1 is collected by microphone 220 built in customer terminal 200 arranged on table T1.
The analog audio signal collected by the microphone 220 is converted into a digital signal, and then supplied to the data processing unit 100 as a signal S220 via the signal line S900. Note that the audio signal collected by the microphone 220 may be supplied to the data processing unit 100 as an analog signal and converted to a digital signal on the data processing unit 100 side.

Since the data processing unit 100 inputs signal lines from each table in parallel, it recognizes that the input audio signal is an audio signal related to an order from the table T1.
As shown in FIG. 26, the input voice signal S220 is first subjected to voice recognition processing in the voice recognition processing unit 120, and the order contents are specified.
That is,
(1) The input audio signal S220 is analyzed, and an acoustic feature amount (acoustic feature) is extracted from the acoustic model stored in the speech recognition memory 130;
(2) The acoustic feature for each extracted phoneme is referred to the recognition dictionary stored in the speech recognition memory 130, and the candidate closest to each phoneme of the input speech signal in the character string data to be recognized is Use voice recognition results (character string data)
(3) Based on the converted character string data, the food and drink related to the order contents are specified, and the order code corresponding to the specified food and drink is output to the CPU 110 with reference to the food and drink data file 140. At that time, based on the converted character string data, data on the quantity of food and drink related to the order is output to the CPU 110 together with the order code.
As a result of the above processing, the speech recognition processing unit 120 extracts character string data of “ramen” and “gyoza” based on the audio signal S220, and the order code “0x02” corresponding to “ramen” and “gyoza”. , “0x03” is referred to from the food / drink data file 140 (see FIG. 27A), and the character string data for each quantity is not extracted. Is done.

The CPU 110 that has input the order code and quantity data first updates the order management file 150. Specifically, as shown in FIG. 27B, based on the input order code and quantity data, data is written to the order code corresponding to the customer table number 1 in the table T1 and its quantity.
Further, as shown in FIG. 26, the CPU 110 connects the customer terminal 200, the shop terminal 300, and the kitchen display unit 400 of the table T <b> 1 via the signal line 900 based on the updated order management file 150. A display control signal S100 for displaying the order reception result is transmitted.
As a result, as shown in FIG. 24, the customer A1 can recognize that the food and drink ordered by himself / herself has been correctly ordered, and the restaurant manager A2 can manage the voucher and the inventory replenishment based on the contents of the order. The kitchen chef A3 can start cooking immediately after recognizing the food and drink related to the order.

  As described above, according to the order receiving device 40 according to the present embodiment, the data processing unit 100 that centrally manages the order receiving status, the customer terminal 200 disposed in a place where food and drink are provided to customers, the restaurant The store terminal 300 disposed in the management place of the restaurant and the kitchen display section 400 disposed in the restaurant kitchen, and the microphone 220 of the customer terminal 200 relates to the order of the customer's food and drink The voice signal is input, the data processing unit 100 specifies the order contents by voice recognition processing based on the voice signal, updates the order management file 150, and the customer terminal 200 based on the updated order management file 150. Since the order receiving result is displayed on the customer terminal display unit 210, the store terminal display unit 310 of the store terminal 300, and the kitchen display unit 400, the following effects can be obtained.

That is,
(1) Since orders for customers' food and drink are received by voice, there is no need for manpower, and the restaurant manager can save labor costs accordingly.
(2) Since the customer who has visited the restaurant only needs to place an order for the customer terminal 200 by voice after coming to the restaurant, there is no wasted time related to ordering such as a waitress taking an order. Since the ordered food and drink can be provided quickly, customer satisfaction is improved.
(3) Even when there is an additional order, the customer does not have to bother to call a waitress or the like and is not cumbersome. As a result, customer satisfaction is improved.
(4) The ordered food and drink is centrally managed by the data processing unit 100, and the order details are immediately displayed on the shop terminal display unit 310 and the kitchen display unit 400. Cooking can be started and restaurant management operations (accounting, purchasing, etc.) can be performed quickly. Furthermore, the problem that the food and drink ordered by the customer does not match the food and drink actually provided does not occur.

Note that the present embodiment is not limited to the above-described contents, and various modifications can be made.
For example,
(1) If a language conversion function is added to the data processing unit 100, it is possible to recognize voices in various languages input by the microphone 220 and specify order contents.
(2) Various contents can be added as contents to be displayed on the customer terminal display unit 210. For example, accounting results and point services related to ordered foods and drinks, notification of event contents, and the like can be considered.
(3) Since the data processing unit 100 centrally manages the order contents, the data processing unit 100 can also be linked with a processing system such as material procurement and accounting for food and drink.
(4) In the above-described embodiment, the signal is transmitted through the signal line 900. However, in order to improve the degree of freedom of installation of the customer terminal 200, the store terminal 300, and the like, it may be performed by wireless communication.
(5) A speaker can be added to the customer terminal 200 to further improve the practicality. For example, it may be possible to output sound such as “I welcome you” or “I received an order” to the speaker. In this case, it is necessary to add a speech synthesis processing unit to the data processing unit 100.

Third Embodiment Next, an order receiving apparatus according to a third embodiment will be described.
In the order receiving device according to the third embodiment, even when there are a plurality of customers in each table, the order receiving device can receive food and drink for each customer.
Therefore, in particular, the order receiving device 40a according to the third embodiment is greatly different from the order receiving device 40 according to the second embodiment in the customer terminal 200.

FIG. 28 is a diagram illustrating an application example of the order receiving device 40a for a restaurant according to the third embodiment.
Hereinafter, as compared with the order receiving device 40 according to the second embodiment, a different configuration of the order receiving device 40a according to the present embodiment (a portion having a reference numeral different from that of the second embodiment) will be described below.
The customer terminal 200a has a microphone selection unit 230 as the microphone selection means of the present invention which is the two-way communication device 1 (call device 1) described in the first embodiment, instead of the microphone 220 of the customer terminal 200. .

Since the microphone selection unit 230 includes directional microphones that are uniformly arranged in all directions, as shown in FIG. 28, the audio signals related to orders of all customers sitting on the table T1 including the customers A1, A1a, etc. In order to catch, it arrange | positions in the center part of table T1 as much as possible.
The customer terminal 200a transmits an audio digital signal supplied to the D / A converter 281 of the DSP 26 built in the microphone selection unit 230 as the audio signal S220 output to the data processing unit (see FIG. 5).
Furthermore, the microphone selection result (see FIG. 5), which is the output of the DSP 25 built in the microphone selection unit 230, is superimposed on the audio signal S220 or sent to the data processing unit 100a through another independent signal line. . Thereby, on the data processing unit 100a side, it is possible to recognize where the input audio signal S220 is an order from a customer sitting in the table T1.

Unlike the data processing unit 100 according to the second embodiment, the data processing unit 100a manages the order reception status for each seat position of each table based on the microphone selection result from the microphone selection unit 230. Therefore, it is registered in advance as to which position of each table each directional microphone of the microphone selection unit 230 is directed.
The order management file 150a (not shown) of the data processing unit 100a is different from the order management file 150 in the second embodiment shown in FIG. 27B in order to perform management in units of seat positions of each table described above. The order code and quantity data are managed for each seat position data of each customer table number.
Based on the order management file 150a updated according to the order, the data processing unit 100a allows the customer terminal display unit 210, the store terminal display unit 310, and the kitchen display unit 400 to display the order reception status for each seat position of each table. A display control signal S100 is transmitted so as to be displayed.

As described above, the order receiving device 40a according to the present embodiment has the microphone selection unit 230 having the features of the communication device described in the first embodiment, and the audio signal output by the microphone selection unit 230. The following effects can be obtained.
That is,
(1) Since the microphone selection unit 230 includes directional microphones arranged in all directions, it is possible to process voice orders from a plurality of customers located in each direction of the table.
(2) Even when customers located in each direction of the table speak at the same time, the microphone selection unit 230 of the customer terminal 200a selects a microphone with a high sound pressure level, and the audio signal of the selected microphone is a data processing unit. In order to supply to 100a, the data processor 100a processes only the audio signal related to the main order. Therefore, the voice recognition processing unit 120 of the data processing unit 100a can correctly perform processing without performing voice recognition processing on a voice signal in which a plurality of voices are mixed.
As a result, customer orders in each table can be processed in turn.
(3) Since there is no need to use a plurality of microphones for each customer and only one microphone selection unit 230 is arranged at the center of each table, the above-described effects can be obtained without feeling uncomfortable for the customers. Can be obtained.

Note that the present embodiment is not limited to the above-described contents, and various modifications can be made.
For example, even if each table is a round table and many people are sitting on one table, if the microphone selection unit 230 is configured to increase the number of directional microphones provided uniformly in all directions, each seat It is possible to receive an order for each position.

(A) is a figure which shows the outline | summary of the conference system as an example to which a two-way communication apparatus is applied, (B) is a figure which shows the state in which the telephone apparatus in (A) is mounted, (C) is a diagram showing the arrangement of the communication device placed on the table and the conference participants. It is a perspective view of a two-way communication device. FIG. 2 is an internal sectional view of the two-way communication device illustrated in FIG. 1. FIG. 2 is a plan view of a microphone / electronic circuit housing unit from which an upper cover of the two-way communication device illustrated in FIG. 1 is removed. It is a figure which shows the connection state of the main circuit of a microphone and an electronic circuit accommodating part, and has shown the connection state of the connection of a 1st digital signal processor (DSP1) and a 2nd digital signal processor (DSP2). FIG. 5 is a characteristic diagram of the microphone illustrated in FIG. 4. (A)-(D) is a graph which shows the result of having analyzed the directivity of the microphone which has the characteristic illustrated in FIG. It is a partial block diagram of the deformation | transformation aspect of a two-way communication apparatus. It is a graph which shows the outline | summary of the whole processing content in a 1st digital signal processor (DSP1). It is a flowchart which shows the 1st form of the noise measuring method of a two-way communication apparatus. It is a flowchart which shows the 2nd form of the noise measuring method of a two-way communication apparatus. It is a flowchart which shows the 3rd form of the noise measuring method of a two-way communication apparatus. It is a flowchart which shows the 4th form of the noise measuring method of a two-way communication apparatus. It is a flowchart which shows the 5th form of the noise measuring method of a two-way communication apparatus. It is drawing which shows the filtering process in a telephone apparatus. It is a frequency characteristic figure which shows the process result of FIG. It is a block diagram which shows a band pass filtering process and a level conversion process. It is a flowchart which shows the process of FIG. It is a graph which shows the process which determines the speech start and completion | finish of a two-way communication apparatus. It is a graph which shows the flow of the normal process of a two-way communication apparatus. It is a flowchart which shows the flow of the normal process of a two-way communication apparatus. It is the block diagram which illustrated the microphone switching process of a two-way communication apparatus. It is the block diagram which illustrated the method of the microphone switching process of a two-way communication apparatus. It is a figure which shows the application example of the order receiving apparatus of the restaurant which concerns on 2nd Embodiment. It is a figure which shows one example of the system configuration | structure of the order receiving apparatus of a restaurant. It is a figure which shows one example of a structure of the data processing part of the order receiving apparatus of a restaurant. It is a figure which illustrates the file managed with the order receiving apparatus of a restaurant. It is a figure which shows the application example of the order receiving apparatus of the restaurant which concerns on 3rd Embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Two-way communication apparatus, MC1-MC6 ... Microphone, 16 ... Reception speaker, 23 ... Microprocessor, 24 ... Codec, 25 ... 1st digital signal processor (DSP1), 26 ... 2nd digital signal processor (DSP2) 27 ... A / D converter block, 28 ... D / A converter block, 29 ... amplifier block, 40,40a ... order receiving device, 100,100a ... data processing unit, 110 ... CPU, 120 ... voice recognition processing unit, DESCRIPTION OF SYMBOLS 130 ... Voice recognition memory, 140 ... Food and drink data file, 150 ... Order management file, 200, 200a ... Customer terminal, 210 ... Customer terminal display part, 220 ... Microphone, 230 ... Microphone selection part, 300 ... Shop terminal 310 ... Store terminal display unit, 400 ... Kitchen display unit.

Claims (5)

An order receiving device of a restaurant that provides a food by receiving a customer order by voice,
First display means for displaying a list of a plurality of foods and drinks that can be provided and provided at a place where food and drink is provided in the restaurant;
A microphone that is arranged at a place to provide food and drink at the restaurant and collects customer orders by voice;
Second display means disposed at a cooking place of the restaurant;
Voice recognition means for performing voice recognition based on the voice collected by the microphone, and identifying food and drink related to the customer's order from the plurality of food and drink based on the result of the voice recognition;
An order receiving apparatus for a restaurant comprising: control means for displaying food and drink specified by the voice recognition means on the first display means and the second display means. And further comprising third display means disposed in a management place for managing the order status of food and drink at the restaurant,
The control means includes
The order receiving apparatus for a restaurant according to claim 1, wherein the food and drink specified by the voice recognition means are displayed on the first display means, the second display means and the third display means. If there are multiple food and beverage provision locations,
The first display means and the microphone are disposed at each providing place,
The restaurant order receiving apparatus according to claim 1, wherein the control unit manages the food and drink specified by the voice recognition unit for each of the providing locations. An order receiving device of a restaurant that provides a food by receiving a customer order by voice,
First display means for displaying a list of a plurality of foods and drinks that can be provided and provided at a place where food and drink is provided in the restaurant;
Based on the sound pressure collected by the microphones, the microphones are arranged at the food and beverage provision location of the restaurant and arranged to direct at least two microphones having different directivities, respectively. A microphone selection means for selecting a microphone;
Second display means disposed at a cooking place of the restaurant;
Voice recognition is performed based on the voice collected by one microphone selected by the microphone selection means, and the food and drink related to the customer's order is selected from the plurality of food and drink based on the result of the voice recognition. A voice recognition means to identify;
An order receiving apparatus for a restaurant comprising: control means for causing the first display means and the second display means to display the food and drink specified by the voice recognition means. An ordering method for a restaurant that provides a food by receiving a customer order by voice,
A list of a plurality of foods and drinks that can be provided is displayed on the first display unit disposed in the place where the food and drink is provided in the restaurant,
Collecting customer orders by voice by using a microphone arranged at a place where food and drink is provided in the restaurant,
Perform voice recognition based on the voice collected by the microphone,
Based on the result of the voice recognition, the food and drink related to the customer's order is identified from the plurality of food and drink,
A method for ordering a restaurant, wherein the identified food and drink are displayed on the first display unit and the second display unit disposed at the cooking place of the restaurant.

Images