JP2022190585A - Order reception apparatus, order reception system, and program - Google Patents

Abstract

To provide an order reception apparatus configured to reliably receive an order through voice of a customer, an order reception system, and a program.SOLUTION: An order reception apparatus includes: an input unit which receives voice information associated with seat information that identifies a seat in a store; a voice recognition unit which recognizes the content indicated by the voice information input to the input unit; a feature extraction unit which extracts feature data indicating features of the voice information input to the input unit; a determination unit which determines whether a speaker of the voice information input to the input unit is a store clerk or not, on the basis of whether the feature data extracted by the feature extraction unit has been stored in a store clerk feature information storage unit that stores feature data of voice information of store clerks; and a reception unit which receives order information generated by associating the order content recognized by the voice recognition unit with the seat information on condition that the determination unit determines that the speaker of the voice information is not a store clerk.SELECTED DRAWING: Figure 10

Description

TECHNICAL FIELD Embodiments of the present invention relate to an order receiving device, an order receiving system, and a program.

In recent years, in restaurants, against the background of labor shortages and the need to reduce conversations between store clerks and customers as a countermeasure against infectious diseases, an order terminal device or the like that allows customers to order by themselves has been used. However, there are many customers who are not accustomed to operating the order terminal device, and there are cases where the customer is puzzled by the operation of the order terminal device. For this reason, it is desired to introduce a system that allows customers to easily place orders.

An order input system using voice recognition has been proposed as a system that allows a customer to place an order without performing complicated operations (for example, Patent Document 1). The order entry system described above accepts customer orders by voice in a so-called drive-thru.

However, if such an order input system using voice recognition is adopted in a store where a plurality of customers exist, there is a possibility that an erroneous order will be accepted based on the voice of a customer who did not intend to place the order or the voice of the clerk. There was a problem.

The problem to be solved by the present invention is to provide an order receiving device, an order receiving system, and a program that can reliably receive an order by customer's voice.

The order receiving device of the embodiment includes an input unit for inputting voice information associated with seat information for identifying customer seats in a store, and a voice recognition unit for recognizing the content indicated by the voice information input to the input unit. a characteristic extraction unit for extracting characteristic data indicating characteristics of the voice information input to the input unit; and a store clerk characteristic information storage unit for storing the characteristic data extracted by the characteristic extraction unit as the characteristic data of the voice information of the sales clerk. a judgment unit for judging whether or not the speaker of the voice information input to the input unit is a salesclerk based on whether or not the speaker of the speech information is stored in the input unit; a reception unit that receives order information in which order details recognized by the voice recognition unit and the seat information are associated with each other on condition that the determination is made.

FIG. 1 is a diagram showing an outline of a store system including an order reception system according to the first embodiment. FIG. 2 is a block diagram showing the hardware configuration of the order receiving device according to the first embodiment. FIG. 3 is a diagram showing the data configuration of the menu master stored in the memory unit of the order receiving device according to the first embodiment. FIG. 4 is a diagram showing the data configuration of a product dictionary file stored in the memory unit of the order receiving device according to the first embodiment. FIG. 5 is a diagram showing the data configuration of an order number dictionary file stored in the memory unit of the order receiving device according to the first embodiment. FIG. 6 is a diagram showing the data configuration of an order management dictionary file stored in the memory section of the order receiving device according to the first embodiment. FIG. 7 is a diagram showing the data configuration of a store clerk characteristic management file stored in the memory unit of the order receiving device according to the first embodiment. FIG. 8 is a diagram showing the data configuration of an order management file stored in the memory section of the order receiving device according to the first embodiment. FIG. 9 is a block diagram showing the functional configuration of the order receiving device according to the first embodiment. FIG. 10 is a sequence chart showing the flow of operations of the order receiving system according to the first embodiment. FIG. 11 is a flow chart showing the flow of order reception processing by the control unit of the order reception device according to the first embodiment. FIG. 12 is a flow chart showing the flow of status update processing by the control unit of the order receiving device according to the first embodiment. FIG. 13 is a block diagram showing the hardware configuration of the order receiving device according to the second embodiment. FIG. 14 is a diagram showing the data configuration of a customer characteristic management file stored in the memory section of the order receiving device according to the second embodiment. FIG. 15 is a block diagram showing the functional configuration of an order receiving system according to the second embodiment. FIG. 16 is a sequence chart showing the flow of operations of the order receiving system according to the second embodiment. FIG. 17 is a flow chart showing the flow of order reception processing by the control unit of the order reception device according to the second embodiment. FIG. 18 is a flow chart showing the flow of status update processing by the control unit of the order receiving device according to the second embodiment.

The order receiving device, order receiving system, and program will be described below. In addition, this invention is not limited by embodiment described below. For example, in the following embodiments, an example in which an order receiving system is employed in a restaurant will be described, but the present invention is not limited to this. The order receiving device can be widely used in stores that receive orders and provide products to customers.

(First embodiment)
An order receiving device, an order receiving system, and a program according to the first embodiment will be described below with reference to the drawings. FIG. 1 is a diagram showing an outline of a store system including an order reception system. The store system 100 is employed in a store that provides products, such as a restaurant with a plurality of seats. The seats installed in the store may be counter seats for individual use, table seats for use by a plurality of people, or standing seats. The store system 100 includes an order reception system 1 and a POS (Point Of Sales) terminal 200 .

The POS terminal 200 is provided at the checkout counter and performs accounting processing regarding payment for customers who have finished eating and drinking. Accounting processing executed by the POS terminal 200 includes, for example, display of product information ordered by the customer, calculation of the amount of change, and payment of change for cash settlement, and the settlement server of the settlement agent for credit settlement. transmission and reception of various information with

The order reception system 1 includes a management server 2 , a customer microphone 3 , a display 4 , a cook microphone 5 , a kitchen display 6 , a kitchen printer 7 and a waiter microphone 8 . These devices are connected to communicate with each other via a network such as a LAN (Local Area Network) or a wireless LAN. Each of the devices described above is communicably connected to the POS terminal 200 via a network. For example, in a store with only counter seats and a clerk who cooks at the counter also provides products to customers, the order reception system 1 selects either the cook microphone 5 or the hall staff microphone 8. Just be prepared.

The management server 2 is arranged in the backyard of the store. The management server 2 receives, from the POS terminal 200, product information of products for which checkout processing has been performed, payment information regarding payment methods, and the like. Further, the management server 2 receives sales information indicating the sales amount from the POS terminal 200 . The management server 2 centrally manages received product information, payment information, sales information, etc., and performs sales management, etc. at one store.

Also, the management server 2 receives order information based on the customer's voice picked up by the customer microphone 3 . The order information includes seat information indicating the positions of the audience seats and order details (information specifying products, information indicating the number of products). Specifically, the management server 2 determines whether the voice information input from the customer microphone 3 is the voice of the customer or the voice of the store clerk. Recognize and accept order information. In the following description, recognizing the contents of voice information may be referred to as voice recognition, and recognizing a speaker based on characteristic data of voice information may be referred to as speaker recognition. Speaker recognition and voice recognition are performed by widely known techniques, and management server 2 receives order information using these voice recognition and speaker recognition. The management server 2 is an example of an order receiving device.

Furthermore, the management server 2 manages the status of the received order information based on the voices picked up by the cook's microphone 5 and the waiter's microphone 8 . For example, the management server 2 stores information such as the completion of cooking of the product related to the received order information, or the provision of the product to the customer. The management server 2 can be said to be an order reception device having an order management function.

A customer microphone 3 is installed corresponding to each audience seat. The customer microphone 3 picks up the voice of the customer in the corresponding audience seat, and outputs voice information of the picked-up voice to the management server 2 together with the microphone number. The microphone No. identifies the microphone installed at the audience seat, in other words, identifies the audience seat where the customer microphone is installed, and is an example of the seat information. The customer microphone 3 is set so as not to pick up the voices of customers in other seats, or not to output them as voice information even if the voices are picked up. For example, when the volume of the input voice is below a predetermined value, the customer microphone 3 determines that it is noise and does not output voice information. Note that the management server 2 may determine noise based on the volume. The customer microphone 3 is an example of a customer sound pickup unit that picks up the voice of a customer positioned at the audience seat and outputs voice information specifying the voice.

The display 4 is set with the customer microphone 3 and installed corresponding to each customer seat. The display 4 displays the order details recognized by the management server 2 based on the voice information output by the corresponding customer microphone 3, for example. After confirming the order contents displayed on the display 4, the management server 2 accepts the order when the customer utters a sound such as "Yes" or "OK" for confirming the order. The display 4 can display other various information. For example, the display 4 can display the menu of the store and product information (product name, price, etc.) of the product ordered by the customer. Note that the indicator 4 may not be provided. Further, instead of the display 4 or in addition to the display 4, a speaker for outputting the contents displayed by the display 4 by voice may be provided.

The cook's microphone 5 picks up the voice of the cook who cooks the product in the kitchen, and outputs voice information of the picked-up voice to the management server 2 . The cook's microphone 5 is, for example, a headset that picks up only the cook's voice. A microphone number for identifying the cook's microphone 5 is also set for the cook's microphone 5 .

The kitchen display 6 is provided in the kitchen, and displays, for example, order information received by the management server 2 and the status of the order information. A cook confirms the order information displayed on the kitchen display 6 and cooks.

The kitchen printer 7 is installed in the kitchen, and prints the order information received by the management server 2 and issues it as a slip. The wait staff gives the customer a slip printed by the kitchen printer 7 when the food ordered by the customer is cooked and the food is served to the customer.

A hall clerk microphone 8 picks up the voice of a hall clerk who moves in a hall where a plurality of seats are installed and provides merchandise to customers, and outputs voice information of the collected voice to a management server 2. - 特許庁The hall staff microphone 8 is composed of, for example, a headset that picks up only the voice of the hall staff. The hall staff microphone 8 is also set with a microphone number for identifying the hall staff microphone 8 .

Next, the management server 2 will be explained in detail. FIG. 2 is a block diagram showing the hardware configuration of the management server 2. As shown in FIG. The management server 2 includes a control section 20 , a memory section 21 , a display section 22 , an operation section 23 and a communication section 24 . The control unit 20, memory unit 21, display unit 22, operation unit 23, and communication unit 24 are connected to each other via a bus 25 or the like.

The control unit 20 is configured by a computer having a CPU (Central Processing Unit) 201 , a ROM (Read Only Memory) 202 and a RAM (Random Access Memory) 203 . CPU 201 , ROM 202 and RAM 203 are connected to each other via bus 25 .

A CPU 201 controls the overall operation of the management server 2 . The ROM 202 stores various programs such as programs used to drive the CPU 201 and various data. A RAM 203 is used as a work area for the CPU 201 and develops various programs and data stored in the ROM 202 and the memory section 21 . The control unit 20 executes various control processes of the management server 2 by the CPU 201 operating according to the control program stored in the ROM 202 and the memory unit 21 and developed in the RAM 203 .

The memory unit 21 is composed of a storage medium such as an HDD (Hard Disk Drive) or flash memory, and maintains stored contents even when the power is turned off. The memory unit 21 stores a control program 211 , a menu master 212 , a product dictionary file 213 , an order quantity dictionary file 214 , an order management dictionary file 215 , an employee characteristic management file 216 and an order management file 217 .

The control program 211 is a program that causes the management server 2 to function as a sales management device, a program that causes the management server 2 to function as an order receiving device, and the like.

The menu master 212 is a master file that stores information on items on the menu of the store. The menu master 212 is updated when the store menu is changed. FIG. 3 is a diagram showing the data structure of the menu master 212. As shown in FIG. The menu master 212 is associated with each piece of information indicating the menu number, product name, and price.

A number set for each product is registered in the menu No. item. The menu number is an example of product identification information for identifying products. Information indicating the name of the product is registered in the item of product name. Information indicating the unit price of a product is registered in the item of price. The unit price may be the body price or the tax-included price including the consumption tax.

The product dictionary file 213 is dictionary data of terms used when recognizing ordered products in order reception by voice recognition. FIG. 4 is a diagram showing the data structure of the product dictionary file 213. As shown in FIG. The product dictionary file 213 is associated with each piece of information indicating product names and terms.

Information indicating the name of the product is registered in the item of product name. Information indicating terms for identifying products is registered in the term item. Terms for identifying products include product names, part of product names, menu numbers, and the like. For example, if the product name is curry rice, the corresponding terms can be "curry rice", "curry", "menu No. 1", and the like.

The order number dictionary file 214 is dictionary data of terms used when recognizing the number of ordered products in order reception by voice recognition. FIG. 5 is a diagram showing the data configuration of the order number dictionary file 214. As shown in FIG. The order quantity dictionary file 214 is associated with each piece of information indicating the order quantity and terms.

Information indicating the number of orders is registered in the item of the number of orders. Information indicating a term for identifying the number of orders is registered in the term item. For example, terms corresponding to the number of orders of 1 are "one", "one", and the like.

The order management dictionary file 215 is dictionary data of terms used when managing order information in order management by voice recognition. FIG. 6 is a diagram showing the data structure of the order management dictionary file 215. As shown in FIG. The order management dictionary file 215 is associated with information indicating update processing and terms.

Information indicating update processing of the status of order information (including registration of order information) is registered in the item of update processing. In the item of update processing, for example, information indicating processing such as order registration, cooking completion, and product provision completion is registered. Information indicating terms used when determining status update processing is registered in the term item. For example, the terms corresponding to order entry are "yes", "ok", and so on. This is a term included in the voice uttered when the customer confirms the order content displayed on the display 4 . Also, terms corresponding to the completion of cooking are "completion", "please", and the like. This is the term contained in the voice that the cook utters after the name of the item when the cooking of the ordered item is completed. Furthermore, terms corresponding to product provision are "Thank you for waiting", "Please", and the like. This is a term that is included in the voice that the hall clerk utters after the name of the product when offering the product to an individual customer.

Note that the memory unit 21 may store other dictionary files. For example, a dictionary file for recognizing drink sizes such as L size, M size, and S size may be provided. The terms used in each dictionary file can be determined according to store rules and operations.

The store clerk characteristic management file 216 is a file for managing voice information characteristic data for each store clerk. The characteristic data of voice information is data for performing speaker recognition, and is, for example, data obtained by frequency analysis of voice. The salesclerk property management file 216 registers data of all salesclerks, but it is sufficient to register data of salesclerks (for example, hall staff) who are likely to utter voices at the audience seats. This is because, in this embodiment, the store clerk characteristics management file 216 is utilized when recognizing whether or not the voice picked up by the customer microphone 3 is the voice of the store clerk. In addition, utilization of data other than hall staff will be described in detail in the second embodiment. The characteristic data of the voice information of the clerk may be registered in advance before business hours, or may be registered when the clerk speaks for the first time during business hours. FIG. 7 is a diagram showing the data structure of the store clerk characteristic management file 216. As shown in FIG. The store clerk characteristics management file 216 is associated with store clerk IDs for identifying store clerk, persons in charge, and pieces of information indicating feature data. The store clerk characteristic management file 216 includes a store clerk characteristic information storage unit that stores the characteristic data of the voice information of the sales clerk, and a store clerk characteristic information storage unit that stores the sales clerk identification information that identifies the sales clerk and the characteristic data of the voice information in association with each other. is an example.

A store clerk ID for identifying a store clerk is registered in the store clerk ID item. The clerk ID is an example of clerk identification information that identifies the clerk. Different store clerk IDs are set for each store clerk. However, all store clerk IDs may be the same. This is because, in the present embodiment, it is not necessary to identify an individual salesclerk, and it is sufficient to identify the salesclerk. Information indicating the person in charge of the store clerk is registered in the item of person in charge. The person in charge is, for example, a cook, a person in charge of a hall, or the like. Utilization of data of this item will be described in the second embodiment. Information indicating characteristic data of audio information is registered in the item of characteristic data.

The order management file 217 is a file for managing the status of order information received from customers. The order management file 217 is updated based on the voice information of voices picked up by the customer microphone 3, the cook microphone 5, and the hall staff microphone 8. FIG. FIG. 8 is a diagram showing the data structure of the order management file 217. As shown in FIG. The order management file 217 is associated with each piece of information indicating seat number, order number, order product name, status, and registration flag.

A number determined for each seat is registered in the item of seat number. The seat number is associated with the microphone number set for each customer's microphone 3, and it can be said that the information indicating the seat number is the information indicating the microphone number. In the following description, registering the seat number may be referred to as registering the microphone number. Information indicating an order number specifying the received order information is registered in the order number item. In this embodiment, an order number is issued for each ordered product, but an order number may be set for all order information received from one seat. Information indicating the name of the ordered product is registered in the item of the ordered product name. Information indicating the status of the received order information is entered in the status item. The status item is rewritten according to the situation after receiving the order information. Information indicating whether the received order information is provisionally registered in an unconfirmed state or final registration in a confirmed state is registered in the item of registration flag. In the registration flag field, "0" is registered when the received order information is provisionally registered, and "1" is registered when it is final registration.

Returning to FIG. 2, the hardware configuration of the management server 2 will be described. The display unit 22 is composed of, for example, a liquid crystal panel, and displays various information. The display unit 22 displays, for example, a registration screen for registering terms in each dictionary file.

The operation unit 23 is composed of a keyboard, a touch panel, and the like. When operated by a customer, the operation unit 23 inputs information corresponding to the operation to the control unit 20 .

The communication unit 24 is an interface for communicating with external devices such as the customer microphone 3 , the display 4 , the cook microphone 5 , the kitchen display 6 , the kitchen printer 7 , the hall staff microphone 8 , and the POS terminal 200 . The control unit 20 can transmit and receive information (data) to and from the external device by being connected to the external device via the communication unit 24 .

Next, the functional configuration of the control unit 20 of the management server 2 will be explained. FIG. 9 is a block diagram showing the main functional configuration of the control unit 20 of the management server 2. As shown in FIG. The control unit 20 operates according to the control programs stored in the ROM 202 and the memory unit 21 by the CPU 201, thereby providing an input unit 2001, a speech recognition unit 2002, a characteristic extraction unit 2003, a speaker identification unit 2004, a determination unit 2005, and a reception unit. It functions as part 2006 and order management part 2007 . Note that each of these functions may be configured by hardware such as a dedicated circuit.

The input unit 2001 receives voice information associated with seat information for identifying customer seats in the store. Specifically, the input unit 2001 receives input of information in which voice information of the voice picked up by the customer microphone 3 is associated with the microphone number of the customer microphone. Further, the input unit 2001 stores information in which the audio information of the audio picked up by the cook's microphone 5 is associated with the microphone number of the cook's microphone 5, and the audio picked up by the hall staff microphone 8. and information in which the microphone number of the hall staff microphone 8 is associated with each other is input.

A speech recognition unit 2002 recognizes the content indicated by the speech information input to the input unit 2001 . Specifically, the voice recognition unit 2002 analyzes voice information of voices picked up by the customer microphone 3, the cook microphone 5, and the hall staff microphone 8, and recognizes the contents indicated by these voice information. The speech recognition unit 2002 also recognizes the order content and the status of the order based on the terms included in the recognized content and each dictionary file. For example, when the content of the recognized voice information includes the term "menu number", the voice recognition unit 2002 recognizes that the voice information is the content of ordering the product corresponding to the menu number. Further, for example, when the content of the recognized voice information includes the word "OK", the voice recognition unit 2002 recognizes that the voice information is the content instructing order registration.

Characteristic extraction section 2003 extracts characteristic data indicating the characteristic of the voice information input to input section 2001 . The characteristic extraction unit 2003, for example, frequency-analyzes the voice information and extracts characteristic data as characteristics. Characteristic data used to identify the speaker is extracted by known methods.

A speaker identification unit 2004 identifies the speaker of the voice information input to the input unit 2001 . The speaker identification unit 2004 refers to the characteristic information that associates the speaker with the characteristic data, and identifies the speaker corresponding to the characteristic data extracted by the characteristic extraction unit 2003 . For example, the speaker identification unit 2004 compares the characteristic data extracted by the characteristic extraction unit 2003 from the voice information input to the input unit 2001 with the characteristic data registered in the store clerk characteristic management file 216, and Identify the speaker of the voice information input to the

Determining unit 2005 is input to input unit 2001 based on characteristic data extracted by characteristic extracting unit 2003 and clerk characteristic information stored in association with clerk identification information for identifying a clerk and characteristic data of voice information. It is determined whether or not the speaker of the received voice information is a store clerk. Specifically, the determination unit 2005 determines whether or not the characteristic data extracted by the characteristic extraction unit 2003 is registered in the employee characteristic management file 216. If registered, the voice information input to the input unit 2001 is processed. is determined to be a store clerk. If the characteristic data extracted by the characteristic extraction section 2003 is not registered in the store clerk characteristic management file 216, the determination section 2005 determines that the speaker of the voice information input to the input section 2001 is not a sales clerk.

Accepting unit 2006 accepts order information in which order details recognized by voice recognition unit 2002 are associated with seat information on the condition that determination unit 2005 determines that the speaker of the voice information is not a salesclerk. Specifically, on the condition that the determination unit 2005 determines that the speaker of the voice information input together with the microphone number of the customer microphone 3 is not a sales clerk, the reception unit 2006 determines that the order content indicated by the voice information is Order information associated with the microphone number is registered in the order management file 217 . In other words, when the voice picked up by the customer microphone 3 is not the voice of the clerk, if the voice information of the voice indicates the details of the order, the order information is accepted based on the details of the order. If the determination unit 2005 determines that the speaker of the voice information is a store clerk, the reception unit 2006 does not accept the order information even if the voice recognition unit 2002 recognizes that the voice information indicates the order details.

In addition, when the voice information input to the input unit 2001 indicates the details of the order from the customer microphone 3, the reception unit 2006 temporarily stores the order information in which the details of the order and the seat number are associated with each other in the order management file 217. sign up. Then, the reception unit 2006 transmits information for the customer to confirm the details of the order to the display device 4 . As a result of confirmation by the customer, when the order information is confirmed, the reception unit 2006 updates the order information in the order management file 217 from temporary registration to permanent registration. That is, the registration flag corresponding to the order information is rewritten from "0" to "1". Accordingly, the receiving unit 2006 receives the order information. Upon receiving the order information, the receiving unit 2006 outputs the received order information to the kitchen display 6 and the kitchen printer 7 . As a result, the kitchen display 6 displays the order information of the newly received order, and the kitchen printer 7 issues a slip for the order information.

The order management section 2007 manages the status of the order information received by the reception section 2006 based on the content recognized by the speech recognition section 2002 . Specifically, the order management unit 2007 updates the order management file 217 based on the microphone number input to the input unit 2001 and the voice information input together with the microphone number. For example, when the content of the voice information input to the input unit 2001 together with the microphone number specifying the cook microphone 5 indicates the completion of cooking, the order management unit 2007 adds "Cooking" to the status item of the order management file 217. registered. If the content of the voice information input to the input unit 2001 together with the microphone number specifying the hall staff microphone 8 indicates that the product has been provided, the order management unit 2007 adds Register "product provided". Then, the order management section 2007 outputs the status of the updated order information to the kitchen display 6 for display.

Next, an overview of order reception and order management by the order reception system 1 will be described. FIG. 10 is a sequence chart showing the flow of operations of the order receiving system 1. As shown in FIG.

When a customer who enters the store and sits at the customer's seat utters the content of the order, the customer's microphone 3 inputs the order (S1). The customer microphone 3 transmits the voice information of the inputted voice along with the microphone number of its own device to the management server 2 (S2).

The management server 2 performs voice recognition on the input voice information and recognizes the order content indicated by the voice information (S3). In addition, the management server 2 performs speaker recognition on the input voice information and confirms that the speaker of the voice information is not a store clerk (S4). By this speaker recognition, for example, even if the customer's microphone 3 picks up a voice such as "Curry and rice has been kept waiting" by a hall staff member when providing a product, it is possible to prevent this from being recognized as an order. . At this time, the management server 2 temporarily registers the order information. Subsequently, the management server 2 transmits the recognized order details to the display device 4 corresponding to the input microphone number (S5).

The display 4 displays the received order details and message. The message displayed by the display 4 prompts the utterance of terms for confirming the order, such as "Would you like to place an order with this content? If you agree, say 'yes'." When the customer confirms the order contents displayed on the display 4 and says "yes", the voice of "yes" is input to the customer microphone 3 as an order confirmation input (S6). The customer microphone 3 transmits the microphone number and the voice information of the input voice to the management server 2 (S7).

The management server 2 performs voice recognition on the input voice information, and recognizes the contents of the confirmed order indicated by the voice information (S8). Further, the management server 2 performs speaker recognition on the input voice information, and confirms that the speaker of the voice information is not a store clerk (S9). Then, the management server 2 accepts the order information by updating the provisional registration of the order information in which the order content and the microphone No. are associated with the official registration (S10). The management server 2 transmits the order information to the kitchen display 6 and the kitchen printer 7 (S11).

In the kitchen, the cook who has confirmed the order content performs the cooking, and when the cooking is completed, the cook utters words including the product name and a term indicating the completion of cooking, for example, "Curry is ready." It is desirable that the restaurant predetermines the words that the cook will say when the cooking is completed. As a result, cooking completion is input to the cook microphone 5 (S12). The cook microphone 5 transmits its own microphone number and voice information to the management server 2 (S13).

The management server 2 performs voice recognition on the input voice information, and recognizes the product name and cooking completion indicated by the voice information (S14). Since the cook's microphone 5 does not pick up the voice of the customer, the management server 2 does not need to perform speaker recognition to determine whether or not the input voice information is the voice of the clerk. The management server 2 updates the status of the order information of the corresponding product to "cooking completed" (S15), and displays the information indicating that the cooking has been completed on a display separately provided in the store or on the headset of the person in charge of the hall. Output to the speaker (S16). This allows the wait staff to recognize that the food has been cooked.

When the finished product is provided to the customer, the wait staff utters a word containing the product name and a term indicating that the product has been provided, for example, "Thank you for waiting curry and rice." It is desirable that the words to be used by the hall clerk at the time of product provision are determined in advance by the store. As a result, the goods provided are input to the hall clerk microphone 8 (S17). The hall staff microphone 8 transmits its own microphone number and voice information to the management server 2 (S18).

The management server 2 performs voice recognition on the input voice information, and recognizes the product name indicated by the voice information and whether the product has been provided (S19). Since the hall staff microphone 8 does not pick up the customer's voice, the management server 2 does not need to perform speaker recognition to determine whether or not the input voice information is the voice of the clerk. The management server 2 updates the status of the order information of the corresponding product to "product provided" (S20).

As described above, the management server 2 can receive customer order information by voice and manage the received order information by voice.

Next, order acceptance processing executed by the management server 2 will be described. FIG. 11 is a flow chart showing the flow of order acceptance processing by the control unit 20. As shown in FIG.

First, the control unit 20 determines whether voice information has been input to the input unit 2001 (S31), and if not (N of S31), returns to the processing of S31 and waits. When voice information is input (Y of S31), the control unit 20 determines whether or not the voice information is input from the customer's microphone 3 based on the microphone number input together with the voice information (S32). .

If the voice information input to the input unit 2001 is input from the customer microphone 3 (Y in S32), the determination unit 2005 determines whether the voice of the voice information input to the input unit 2001 is the voice of the clerk. Determine (S33). If it is not the clerk's voice (Y of S33), the voice recognition unit 2002 determines whether or not the voice information indicates the details of the order (S34).

If the content recognized by the voice recognition unit 2002 indicates the order content (Y in S34), the reception unit 2006 temporarily registers the order information in which the microphone No. and the order content are associated with each other in the order management file 217 ( S35), information for the customer to confirm the order is sent to the display 4 (S35). Then, the control unit 20 returns to the process of S31.

In the processing of S32, if the voice information input to the input unit 2001 is not from the customer microphone 3 (N of S32), the control unit 20 terminates the order acceptance processing. Similarly, in the process of S33, if the voice picked up by the customer microphone 3 is the clerk's voice (N of S33), the control unit 20 ends the order acceptance process.

In addition, in the processing of S34, if the content recognized by the voice recognition unit 2002 does not indicate the order content (N of S34), the voice recognition unit 2002 determines whether the content recognized from the voice information is an order confirmation input. It judges (S37). If it is an order confirmation input (Y of S37), the reception unit 2006 officially registers the temporarily registered order information (S38), and transmits the officially registered order information to the kitchen display 6 and the kitchen printer 7 (S39). ). Then, the control unit 20 terminates the order acceptance process. In the processing of S37, if the voice recognition unit 2002 determines that the input is not the order confirmation input (N of S37), the control unit 20 ends the order acceptance processing.

Next, status update processing executed by the management server 2 will be described. FIG. 12 is a flowchart showing the flow of status update processing by the control unit 20. As shown in FIG.

First, the control unit 20 determines whether voice information has been input to the input unit 2001 (S41), and if not (N of S41), returns to the processing of S41 and waits. When the voice information is input (Y of S41), the control unit 20 determines whether the voice information is input from the cook's microphone 5 based on the microphone number input together with the voice information (S42). ).

When the voice information input to the input unit 2001 is input from the cook microphone 5 (Y in S42), the voice recognition unit 2002 determines whether the voice information indicates the product name and the completion of cooking. It judges (S43). If the content recognized by the voice recognition unit 2002 indicates the product name and its cooking completion (Y in S43), the order management unit 2007 registers "cooking completed" in the status item corresponding to the product name. update the order management file 217 (S44). When the order management file 217 registers multiple items of the same product, the order management unit 2007 updates the status of the order registered earliest. Note that the order information whose status is to be updated may be specified by having the cook vocalize the order number in addition to the product name, and the management server 2 recognizes the order number.

Subsequently, the order management unit 2007 notifies the wait staff by outputting information to the effect that the cooking is completed to a display provided separately in the store or a speaker provided in the headset of the wait staff (S45). Then, the control unit 20 ends the status update process. In the processing of S43, if the content recognized by the voice recognition unit 2002 does not indicate the name of the product and the completion of cooking (N of S43), the control unit 20 skips the processing of S44 and S45 and performs the status update processing. exit.

In the process of S42, if the voice information input to the input unit 2001 is not from the cook microphone 5 (N at S42), the control unit 20 determines whether the voice information was input from the hall staff microphone 8. It is determined whether or not (S46).

If the voice information input to the input unit 2001 is input from the hall staff microphone 8 (Y in S46), the voice recognition unit 2002 determines whether the voice information indicates the name of the product and whether the product has been provided. It is determined whether or not (S47). If the content recognized by the speech recognition unit 2002 indicates the product name and the product has been provided (Y in S47), the order management unit 2007 adds "product has been provided" to the status item corresponding to the product name. Register and update the order management file 217 (S48). Then, the control unit 20 ends the status update process.

In the process of S46, if the voice information input to the input unit 2001 is not from the hall staff microphone 8 (N of S46), the control unit 20 terminates the status update process. Similarly, in the processing of S47, if the content recognized by the speech recognition unit 2002 does not indicate that the product has been provided (N of S47), the control unit 20 ends the status update processing.

As described above, when voice information associated with the microphone number is input to the input unit 2001, the management server 2 of the first embodiment determines which customer's microphone 3 the voice information is from based on the microphone number. Also, the management server 2 determines that the voice information input from the customer microphone 3 is not the voice information of the store clerk by means of speaker recognition. Furthermore, the management server 2 recognizes the order content from the input voice information by voice recognition. As a result, the management server 2 can reliably accept orders from customers by voice.

Further, when the voice information associated with the microphone number is input to the input unit 2001, the management server 2 of the first embodiment determines which clerk's microphone the voice information is from based on the microphone number. Also, the management server 2 recognizes the content for updating the status from the input voice information by voice recognition. Thereby, the management server 2 can manage the order information by voice.

(Second embodiment)
Next, a second embodiment will be described. The second embodiment differs from the first embodiment in that the number of microphones can be reduced by identifying the customer whose voice is picked up by the customer microphone 3 through speaker recognition. . Hereinafter, descriptions of configurations and functions similar to those of the first embodiment may be omitted or simplified. This is to avoid unnecessary verbosity in the following description and to facilitate understanding by those skilled in the art.

In this embodiment, the customer microphones 3 are not provided corresponding to the audience seats, but are adapted to pick up the voices of customers at a plurality of audience seats. . Also, the hall staff microphone 8 is not provided, and the customer microphone 3 picks up the voice of the hall staff as well.

FIG. 13 is a diagram showing the hardware configuration of the management server 2 of this embodiment. The memory unit 21 of the management server 2 stores a customer characteristic management file 218 in addition to the file of the first embodiment.

The customer characteristic management file 218 is a file for managing characteristic data of voice information for each customer. The customer characteristic management file 218 is utilized when recognizing the speaker of the voice picked up by the customer microphone 3 . FIG. 14 is a diagram showing the data configuration of the customer characteristic management file 218. As shown in FIG. The customer characteristic management file 218 is associated with each piece of information indicating the seat number and characteristic data. The customer characteristic management file 218 is an example of a customer characteristic information storage unit that associates the characteristic data extracted by the characteristic extraction unit 2003 with seat information.

A seat number indicating the number of the audience seat is registered in the item of seat number. Information indicating characteristic data of audio information is registered in the item of characteristic data. Information registered in these items is registered as follows. When the customer enters the store and takes a seat at the customer's seat, the customer utters the seat number specifying the customer's seat according to the indication of the display 4. - 特許庁The display 4 displays, for example, "Please say your seat number." The customer microphone 3 transmits voice information generated by the customer to the management server 2 . In the management server 2, the voice recognition unit 2002 recognizes the seat number, and the characteristic extraction unit 2003 extracts characteristic data from the voice information. The management server 2 associates these seat numbers with characteristic data and registers them in the customer characteristic management file 218 .

Next, the functional configuration of the control unit 20 of the management server 2 will be explained. FIG. 15 is a block diagram showing the main functional configuration of the control unit 20 of the management server 2. As shown in FIG. The control unit 20 operates according to the control programs stored in the ROM 202 and the memory unit 21 by the CPU 201, and the control unit 20 includes an input unit 2001, a speech recognition unit 2002, a characteristic extraction unit 2003, a speaker identification unit 2004, a reception unit 2006, an order It functions as a management section 2007 and a registration section 2008 . Note that each of these functions may be configured by hardware such as a dedicated circuit.

Voice information is input to the input unit 2001 . Specifically, voice information of voice picked up by the customer microphone 3 is input. The customer microphone 3 is a microphone provided in the hall, and functions as a common microphone for picking up voices of a plurality of customers and hall staff. Further, the input unit 2001 receives information in which the audio information of the audio picked up by the cook's microphone 5 and the microphone number of the cook's microphone 5 are associated with each other.

Since the functions of the speech recognition unit 2002, the characteristic extraction unit 2003, and the order management unit 2007 are the same as those of the first embodiment, overlapping descriptions will be omitted.

The speaker identification unit 2004 compares the characteristic data extracted by the characteristic extraction unit 2003 from the voice information input to the input unit 2001 with the characteristic data registered in the store clerk characteristic management file 216 and the customer characteristic management file 218. , to identify the speaker of the voice information input to the input unit 2001 .

When the content recognized by the speech recognition unit 2002 includes order details, the reception unit 2006 associates seat information corresponding to the feature data extracted by the feature extraction unit 2003 in the customer feature information with the order details. receive order information. Specifically, when the content of voice information recognized by the voice recognition unit 2002 includes order details, the reception unit 2006 refers to the customer characteristic management file 218 to match the characteristic data of the voice information. Extract the seat number. Then, the reception unit 2006 receives order information in which the order details recognized by the voice recognition unit 2002 are associated with the extracted seat numbers.

When the content recognized by the voice recognition unit 2002 includes seat information for identifying the customer seats in the store, the registration unit 2008 registers customer characteristic information in which the characteristic data extracted by the characteristic extraction unit 2003 and the seat information are associated with each other. to register. Specifically, when the content indicated by the voice information input to the input unit 2001 includes the seat number, the registration unit 2008 determines that the voice information is voice information for characteristic data extraction, The characteristic data of the voice information extracted by the characteristic extraction unit 2003 is registered (stored) in the customer characteristic management file 218 in association with the seat number.

Next, an overview of order reception and order management by the order reception system 1 will be described. FIG. 16 is a sequence chart showing the flow of operations of the order receiving system 1. As shown in FIG.

When the customer enters the store and sits at the customer's seat, he or she utters the seat number of the customer's seat according to the guidance displayed on the display 4. - 特許庁As a result, voice including the seat number is input to the customer microphone 3 (S51). The customer microphone 3 transmits voice information of the input voice to the management server 2 (S52).

The management server 2 performs voice recognition on the input voice information, and extracts the seat number if the recognized content includes the seat number (S53). Next, the management server 2 extracts characteristic data from the input voice information (S54), associates the extracted characteristic data with the seat number, and registers them in the customer characteristic management file 218 (S55). As a result, the seat number of the audience seat where the customer is seated is associated with the feature of the customer's voice.

After that, when the customer vocalizes the details of the order, voice including the details of the order is input to the customer microphone 3 (S56). The customer microphone 3 transmits voice information of the input voice to the management server 2 (S57).

The management server 2 performs voice recognition on the input voice information, recognizes the content indicated by the voice information (S58), and recognizes the speaker if the order content is included in the recognized content (S59). Specifically, the management server 2 extracts characteristic data from the input voice information, refers to the customer characteristic management file 218, and identifies the corresponding seat number. Subsequently, the management server 2 transmits the recognized order details to the display device 4 corresponding to the identified seat number (S60). At this time, the management server 2 provisionally registers order information in which order details and seat numbers are associated with each other.

When a voice indicating an order confirmation input is input to the customer microphone 3 (S61), the customer microphone 3 transmits voice information of the input voice to the management server 2 (S62).

The management server 2 performs voice recognition on the input voice information, and recognizes the contents of the confirmed order indicated by the voice information (S63). The management server 2 also performs speaker recognition on the input voice information and confirms that the speaker of the voice information is the customer registered in the customer characteristic management file 218 (S64). Then, the management server 2 refers to the customer characteristic management file 218 and accepts the order information by updating the temporary registration in which the recognized order content and the seat No. are associated with the actual registration. (S65). The management server 2 transmits the registered order information to the kitchen display 6 and the kitchen printer 7 (S66).

In the kitchen, the cook who has confirmed the order content performs the cooking, and when the cooking is completed, the cook utters words including the product name and the term indicating the completion of cooking. As a result, the completion of cooking is input to the cook's microphone 5 (S67). The cook microphone 5 transmits its own microphone number and voice information to the management server 2 (S68).

The management server 2 performs voice recognition on the input voice information, and recognizes the product name and cooking completion indicated by the voice information (S69). The management server 2 updates the status of the order information of the corresponding product to "cooking completed" (S70), and outputs information indicating that the cooking is completed to a display or the like separately provided in the store (S71). This allows the wait staff to recognize that the food has been cooked.

When the completed product is provided to the customer at the audience seat, the waiter utters words including the product name and a term indicating that the product has been provided. As a result, the customer's microphone 3 receives an input indicating that the product has been provided (S72). The customer microphone 3 transmits the voice information to the management server 2 (S73).

The management server 2 performs voice recognition on the input voice information, and recognizes the product name indicated by the voice information and whether the product has been provided (S74). The management server 2 also performs speaker recognition on the input voice information, and confirms that the speaker of the voice information is the store clerk (hall staff) registered in the store clerk characteristics management file 216 (S75). . The management server 2 updates the status of the order information of the corresponding product to "product provided" (S76).

As described above, the management server 2 receives customer order information by voice and manages the received order information by voice without providing a microphone corresponding to each customer seat and without providing a hall staff microphone 8. be able to.

Next, order acceptance processing executed by the management server 2 will be described. FIG. 17 is a flow chart showing the flow of order acceptance processing by the control unit 20. As shown in FIG.

First, the control unit 20 determines whether voice information has been input to the input unit 2001 (S81), and if not (N of S81), returns to the processing of S81 and waits. When the voice information is input (Y of S81), the voice recognition unit 2002 determines whether or not the seat number is included in the content of the voice information (S82).

If the content of the voice information includes the seat number (Y of S82), the characteristic extraction unit 2003 extracts the characteristic data of the voice information input to the input unit 2001 (S83). Next, the reception unit 2006 associates the seat number recognized by the voice recognition unit 2002 with the characteristic data extracted by the characteristic extraction unit 2003, and registers them in the customer characteristic management file 218 (S84). Then, the control unit 20 returns to the process of S81.

In the processing of S82, if the content of the voice information does not include the seat number (N of S82), the voice recognition unit 2002 determines whether or not the content of the voice information indicates the details of the order (S85). ). If it is the order content (Y of S85), the characteristic extraction unit 2003 extracts the characteristic data of the voice information (S86). The control unit 20 determines whether or not the extracted characteristic data is registered in the customer characteristic management file 218 (S87). If it is registered (Y in S87), the reception unit 2006 temporarily registers the order information in which the seat number associated with the characteristic data and the order details are associated with each other in the order management file 217 (S88). transmits information for confirming the order to the display 4 (S89). Then, the control unit 20 returns to the process of S81.

In the process of S87, if the extracted characteristic data is not registered in the customer characteristic management file 218 (N of S87), the control unit 20 displays an error prompting the customer to start again from uttering the seat number. is displayed on the display 4 (S90), and the order acceptance process is terminated.

In addition, in the process of S85, if the content of the voice information does not indicate the content of the order (N of S85), the voice recognition unit 2002 determines whether or not the content of the voice information is an order confirmation input (S91). . If it is an order confirmation input (Y of S91), the characteristic extraction unit 2003 extracts characteristic data of voice information (S92). The control unit 20 determines whether or not the extracted characteristic data is registered in the customer characteristic management file 218 (S93). If it is registered (Y in S93), the reception unit 2006 searches the order management file 217 using the seat number associated with the characteristic data as a key, and officially registers the order information including the seat number in question ( S94), the officially registered order information is transmitted to the kitchen display 6 and the kitchen printer 7 (S95). Then, the control unit 20 terminates the order acceptance process.

In the processing of S91, when the voice recognition unit 2002 determines that the input is not the order confirmation input (N of S91), the control unit 20 ends the order reception processing. Further, in the process of S93, if the extracted characteristic data is not registered in the customer characteristic management file 218 (N of S93), the control section 20 proceeds to the process of S90.

Next, status update processing executed by the management server 2 will be described. FIG. 18 is a flowchart showing the flow of status update processing by the control unit 20. As shown in FIG.

First, the control unit 20 determines whether or not voice information has been input to the input unit 2001 (S101), and if not (N of S101), returns to the processing of S101 and waits. When voice information is input (Y of S101), the characteristic extraction unit 2003 extracts characteristic data of the input voice information (S102). The control unit 20 refers to the employee characteristic management file 216 and determines whether or not the employee identified by the employee ID corresponding to the characteristic data extracted by the characteristic extraction unit 2003 is a cook (S103).

If the voice information input to the input unit 2001 is that of the cook (Y in S103), the voice recognition unit 2002 determines whether the voice information indicates the product name and cooking completion (S104). . If the content recognized by the voice recognition unit 2002 indicates the product name and its cooking completion (Y in S104), the order management unit 2007 registers "cooking complete" in the status item corresponding to the product name. to update the order management file 217 (S105).

Subsequently, the order management unit 2007 outputs information to the effect that the cooking has been completed to a display or the like separately provided in the store to notify the waiter (S106). Then, the control unit 20 ends the status update process. In the processing of S104, if the content recognized by the voice recognition unit 2002 does not indicate the product name and its cooking completion (N of S104), the control unit 20 skips the processing of S105 and S106 and performs the status update processing. exit.

In the process of S103, if the voice information input to the input unit 2001 is not that of the cook (N of S103), the control unit 20 refers to the store clerk characteristic management file 216, It is determined whether or not the clerk identified by the clerk ID corresponding to the data is the hall clerk (S107).

If the voice information input to the input unit 2001 is that of the hall clerk (Y in S107), the voice recognition unit 2002 determines whether or not the voice information indicates the name of the product and whether the product has been provided ( S108). If the content recognized by the voice recognition unit 2002 indicates the product name and the product has been provided (Y in S108), the order management unit 2007 adds "product has been provided" to the status item corresponding to the product name. Register and update the order management file 217 (S109). Then, the control unit 20 ends the status update process.

In the process of S107, if the voice information input to the input unit 2001 is not that of the person in charge of the hall (N of S107), the control unit 20 ends the status update process. Similarly, in the processing of S108, if the content recognized by the speech recognition unit 2002 does not indicate that the product has been provided (N of S108), the control unit 20 ends the status update processing.

As described above, the management server 2 of the second embodiment associates the characteristic data of the voice information with the seat number when the content of the voice information input to the input unit 2001 includes the seat number, and Register in property management file 218 . Then, the management server 2 recognizes which seat No. the customer of the input voice information is by means of speaker recognition. Also, the management server 2 recognizes the order content from the input voice information by voice recognition. As a result, the management server 2 can not only reliably accept orders from customers by voice, but also can reduce the number of microphones that pick up voice.

In addition, the management server 2 of the second embodiment determines which clerk the voice information input to the input unit 2001 belongs to by means of speaker recognition. Then, the management server 2 recognizes the content for updating the status from the input voice information by voice recognition. Thereby, the management server 2 can manage the order information by voice.

As described above, the order receiving device of the above embodiment includes an input unit 2001 for inputting voice information associated with seat information for identifying customer seats in a store, and content indicated by the voice information input to the input unit 2001. a voice recognition unit 2002 for recognizing the voice information input to the input unit 2001; Based on store clerk characteristic information (clerk characteristic management file 216) storing identification information and characteristic data of voice information in association with each other, it is determined whether or not the speaker of the voice information input to the input unit 2001 is a sales clerk. and a reception for accepting order information in which the order content recognized by the speech recognition unit 2002 and the seat information are associated with each other on condition that the decision unit 2005 determines that the speaker of the voice information is not a salesclerk. a unit 2006;

As a result, the order receiving device can reliably receive an order by customer's voice even in a store where a plurality of customers are present. Therefore, the customer can easily order the product without having to operate the order input device or the like.

The order receiving device of the above embodiment also includes an input unit 2001 for inputting voice information, a voice recognition unit 2002 for recognizing the content indicated by the voice information input to the input unit 2001, and a Characteristic extraction unit 2003 for extracting characteristic data indicating characteristics of voice information, and characteristic data extracted by characteristic extraction unit 2003 when the content recognized by the voice recognition unit 2002 includes seat information for identifying customer seats in the store. and the corresponding seat information (customer characteristic management file 218) for registering customer characteristic information (customer characteristic management file 218); A reception unit 2006 that receives order information in which seat information corresponding to the characteristic data extracted by the characteristic extraction unit 2003 is associated with the order details.

As a result, even in a store where a plurality of customers are present, the order receiving device can not only reliably accept orders by voice of the customers, but also can increase the number of microphones for picking up the voices of the customers and clerks. can be reduced. Therefore, the customer can easily order the product, and the store can reduce the load required for the equipment.

Furthermore, the order receiving device of the above embodiment further includes an order management section 2007 that manages the status of the order information received by the receiving section 2006 based on the content recognized by the speech recognition section 2002 .

As a result, the order receiving device can also manage the status of the order information by voice. Therefore, it is possible to easily manage the status of order information.

In addition, the order receiving device of the above-described embodiment further includes a speaker identification unit 2004 that identifies the speaker of the voice information input to the input unit 2001. and the recognition contents of the voice recognition unit 2002, the status of the order information is managed.

As a result, the order receiving device can more accurately manage the status of order information by voice.

In addition, the speaker identifying unit 2004 of the order receiving device of the above-described embodiment provides the input unit 2001 with information based on store clerk characteristic information in which the store clerk identification information for identifying the store clerk and the characteristic data extracted by the characteristic extracting unit 2003 are associated with each other. The store clerk who is the speaker of the input voice information is specified.

As a result, the order receiving device can reduce the number of microphones that pick up the voice of the clerk when managing the status of the order information by voice. Therefore, the store can reduce the burden required for the equipment.

In each of the above-described embodiments, the control program executed by the management server 2 may be configured to be recorded in a computer-readable recording medium such as a CD-ROM and provided. Further, the control program executed by the management server 2 of each of the above embodiments may be stored on a computer connected to a network such as the Internet, and may be provided by being downloaded via the network. may be configured to be provided via a network such as the Internet.

Although the embodiment of the present invention has been described above, this embodiment is presented as an example and is not intended to limit the scope of the invention. This embodiment can be implemented in various other forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention.

1 order reception system 2 management server (order reception device)
3 Customer microphone (customer pickup)
216 clerk characteristic management file (clerk characteristic information storage unit)
218 Customer Characteristics Management File (Customer Characteristics Information Storage Unit)
2001 input unit 2002 speech recognition unit 2003 characteristic extraction unit 2004 speaker identification unit 2005 determination unit 2006 reception unit 2007 order management unit

JP 2016-21196 A

Claims (9)

an input unit for inputting voice information associated with seat information for identifying customer seats in the store;
a voice recognition unit that recognizes the content indicated by voice information input to the input unit;
a characteristic extraction unit for extracting characteristic data indicating characteristics of audio information input to the input unit;
The speaker of the voice information input to the input unit is determined based on whether or not the characteristic data extracted by the characteristic extraction unit is stored in a store clerk characteristic information storage unit that stores the characteristic data of the voice information of the sales clerk. a determination unit that determines whether or not it is a store clerk;
a reception unit that receives order information in which the order content recognized by the voice recognition unit and the seat information are associated with each other on condition that the determination unit determines that the speaker of the voice information is not a salesclerk;
An order receiving device comprising: an input unit into which voice information is input;
a voice recognition unit that recognizes the content indicated by voice information input to the input unit;
a characteristic extraction unit for extracting characteristic data indicating characteristics of audio information input to the input unit;
When the content recognized by the voice recognition unit includes seat information for identifying customer seats in the store, the characteristic data extracted by the characteristic extraction unit and the seat information are associated and registered in the customer characteristic information storage unit. a registry;
Order information obtained by associating seat information corresponding to the characteristic data extracted by the characteristic extraction unit and the order contents in the customer characteristic information storage unit when the contents recognized by the voice recognition unit include the order contents. a reception unit that receives the
An order receiving device comprising: further comprising an order management unit that manages the status of the order information received by the reception unit based on the content recognized by the voice recognition unit;
3. The order receiving device according to claim 1 or 2. further comprising a speaker identification unit that identifies a speaker of the audio information input to the input unit;
The order management unit manages the status of the order information based on the result of speaker identification by the speaker identification unit and the recognition content of the speech recognition unit.
The order receiving device according to claim 3. The speaker identification unit is identified by salesclerk identification information corresponding to the characteristic data extracted by the characteristic extraction unit in a salesclerk characteristic information storage unit that stores salesclerk identification information identifying a salesclerk in association with the characteristic data. Identifying the clerk as the speaker of the voice information input to the input unit;
The order receiving device according to claim 4. A customer sound pickup unit arranged corresponding to a customer seat in a store, picking up the voice of a customer positioned at the customer seat and outputting voice information specifying the voice, and outputting the customer sound collecting unit. An order reception system comprising an order reception device that receives an order from a customer based on voice information,
The order receiving device
an input unit for inputting voice information associated with seat information for identifying customer seats in the store;
a voice recognition unit that recognizes the content indicated by voice information input to the input unit;
a characteristic extraction unit for extracting characteristic data indicating characteristics of audio information input to the input unit;
The speaker of the voice information input to the input unit is determined based on whether or not the characteristic data extracted by the characteristic extraction unit is stored in a store clerk characteristic information storage unit that stores the characteristic data of the voice information of the sales clerk. a determination unit that determines whether or not it is a store clerk;
a reception unit that receives order information in which the order content recognized by the voice recognition unit and the seat information are associated with each other on condition that the determination unit determines that the speaker of the voice information is not a salesclerk;
order reception system. A sound pickup unit for a customer that picks up the voice of a customer positioned at a customer seat in a store and outputs voice information that specifies the voice, and an order from the customer based on the voice information output by the sound pickup unit for the customer. An order reception system comprising an order reception device that receives
The order receiving device
an input unit into which voice information is input;
a voice recognition unit that recognizes the content indicated by voice information input to the input unit;
a characteristic extraction unit for extracting characteristic data indicating characteristics of audio information input to the input unit;
When the content recognized by the voice recognition unit includes seat information for identifying customer seats in the store, the characteristic data extracted by the characteristic extraction unit and the seat information are associated and registered in the customer characteristic information storage unit. a registry;
Order information obtained by associating seat information corresponding to the characteristic data extracted by the characteristic extraction unit and the order contents in the customer characteristic information storage unit when the contents recognized by the voice recognition unit include the order contents. a reception unit that receives the
order reception system. A program for controlling an order reception device with a computer,
said computer,
an input unit for inputting voice information associated with seat information for identifying customer seats in the store;
a voice recognition unit that recognizes the content indicated by voice information input to the input unit;
a characteristic extraction unit for extracting characteristic data indicating characteristics of audio information input to the input unit;
The speaker of the voice information input to the input unit is determined based on whether or not the characteristic data extracted by the characteristic extraction unit is stored in a store clerk characteristic information storage unit that stores the characteristic data of the voice information of the sales clerk. a determination unit that determines whether or not it is a store clerk;
a reception unit that receives order information in which the order content recognized by the voice recognition unit and the seat information are associated with each other on condition that the determination unit determines that the speaker of the voice information is not a salesclerk;
A program that works as A program for controlling an order reception device with a computer,
said computer,
an input unit into which voice information is input;
a voice recognition unit that recognizes the content indicated by voice information input to the input unit;
a characteristic extraction unit for extracting characteristic data indicating characteristics of audio information input to the input unit;
When the content recognized by the voice recognition unit includes seat information for identifying customer seats in the store, the characteristic data extracted by the characteristic extraction unit and the seat information are associated and registered in the customer characteristic information storage unit. a registry;
Order information obtained by associating seat information corresponding to the characteristic data extracted by the characteristic extraction unit and the order contents in the customer characteristic information storage unit when the contents recognized by the voice recognition unit include the order contents. a reception unit that receives the
A program that works as

Images