KR20200004655A - Smart ordering system and method using artificial intelligence - Google Patents

Abstract

The present invention discloses a smart order system, as an audio apparatus using an artificial intelligence secretarial function, including: an audio input/output apparatus which processes voice recognition for voice that a customer speaks, responds to questions from a customer, receives voice and outputs composite voice in a process taking order through conversations with a customer and providing menu information using customer information; and a POS terminal which compounds the voice for the conversations with the customer to output the voice through the audio input/output apparatus based on text information received from a voice recognition server processing voice recognition and/or a natural language process server managing conversations, and figures out an order from the conversation content. According to the present invention, it is possible to take and process an order from a customer at a store by using an artificial intelligence speaker which uses artificial intelligence technologies for voice recognition and voice compound.

Description

Smart ordering system and method using artificial intelligence {SMART ORDERING SYSTEM AND METHOD USING ARTIFICIAL INTELLIGENCE}

The present invention relates to a smart ordering system and method using artificial intelligence, and more particularly, to a smart ordering and payment system and method for ordering drinks or food using an audio input / output device that recognizes speech in a cafe or restaurant. .

In the past, if the interface between man and machine was based on touch relations in the third industrial revolution, the basis of the interface between man and machine is expected to be based on human voice.

What is needed to achieve an interface based on human voice is audio technology and intelligent personal assistant technology. Audio technology collects the highest quality voice information that can be recognized by the machine from human voice, and the collected voice information is interpreted into a machine-recognized language by the artificial intelligence assistant technology.

Recently, the AI speaker is located in the representative service using the artificial intelligence assistant and voice recognition. The AI speaker corresponding to the audio input / output device is operated by an AI algorithm that performs an AI assistant function. The AI speaker differs from the general speaker in that it performs a function of listening to music and searching information by using voice recognition through audio input and output.

AI speakers, which combine AI-based speech natural language processing technology with next-generation home automation technology to create an automated environment for users, are expanding their markets around Amazon and Google.

The function of AI speakers is expanding. From early music listening and weather search to smart home, online shopping, delivery food ordering, etc., it is now possible to make phone call and voice payment.

However, the service provided by the AI speaker is still limited to the home service. According to a recent survey by US Internet companies, customers of AI speakers use AI speakers mainly for general questions, weather, stream music, time / alarms, schedule checks, home automation, stream news, games, and shopping. do.

Smart ordering system and method using the artificial intelligence according to an embodiment of the present invention, characterized in that to provide a service to receive a menu guide, order and payment through a dialogue with the AI speaker provided in the seat or kiosk It is done. In this regard, the smart ordering system and method using artificial intelligence according to an embodiment of the present invention is disclosed to solve the problems that the prior art is distinguished from the above-described prior art.

Korea Patent Publication No. 10-0932453 (2009.12.09.)

The problem to be solved by the present invention is to provide a smart ordering system and method for providing a personalized ordering service through voice recognition and speech synthesis technology based on a database built using the menu information and past history information about customer visits will be.

An object of the present invention is to provide a smart ordering system and method that can process orders from customers without the help of the store personnel through the artificial intelligence speaker using the voice assistant and the artificial intelligence function of speech synthesis.

In addition, to provide a smart ordering system and method that can attract customers through the artificial intelligence speaker using the artificial intelligence function related to speech recognition and speech synthesis.

A smart ordering system according to an embodiment of the present invention is an audio device using an intelligent personal assistant function. The smart ordering system processes a voice recognition of a voice spoken by a customer, responds to a customer's question, and receives customer information. An audio input / output device configured to receive a voice and output a synthesized voice in a process of receiving an order through dialogue with a customer and providing menu information; And synthesizing a voice about the conversation with the customer based on the text information transmitted from the speech recognition server processing the speech recognition and / or the natural language processing server managing the conversation, and outputting the speech through the audio input / output device. It characterized in that it comprises a POS terminal to grasp the order.

The audio input / output device may include: an audio input interface for receiving a voice signal and converting the voice signal into data; and an audio output interface for outputting a synthesized voice signal using text generated according to natural language processing; And a communication interface capable of bidirectional communication with a voice recognition server, a natural language processing server, and a POS terminal.

Here, the POS terminal, characterized in that it comprises an order processing module for generating the order information after confirming the identified order content through voice output and voice recognition.

Here, the POS terminal, characterized in that for transmitting the order information to the kitchen terminal through the order processing module, confirming the order processing from the kitchen terminal.

Here, the POS terminal, the customer information database including the historical information about the visit and order history and reservation of the customer and the menu information including the special menu information organized by the day-to-day supply of food materials according to the season And an information management module for establishing a database and managing them.

Here, the POS terminal is characterized in that it leads the customer-specific conversation by providing the customer information to the natural language processing server or by completing the text information transmitted from the natural language processing server using the customer information.

The POS terminal may provide the customized menu information for each customer by providing the special menu information to the natural language processing server or by completing text information transmitted from the natural language processing server using the special menu information.

Smart ordering method according to an embodiment of the present invention, the customer recognizes the voice spoken, responds to the customer's questions, dialogue with the customer using the customer's personal information, providing information and ordering the menu for the customer to order Conducting a conversation with a customer through an audio input / output device using an artificial intelligence function for receiving a voice and outputting a synthesized voice for reception; Generating order information including the table number, the customer number, and the order contents according to the conversation contents with the customer; And processing order details to confirm order information delivery and information delivery.

Here, the step of conducting a conversation with the customer may include the step of recognizing the customer using the prestored customer information for the registered customer, checking the customer information for the unregistered customer, and registering the customer. It features.

In this case, the step of conducting a conversation with the customer may include a step of conducting a personalized conversation for each customer by using customer information including information about the visit and order history and reservation of the customer through the established database. It is done.

Here, the step of conducting a dialogue with the customer may provide customized menu information by using menu information on a special menu organized by day in accordance with customer information and seasonal supply and demand of food materials through a built database. Characterized in that it comprises a step.

The generating of the order information may include: identifying order contents based on contents of a conversation with a customer; And confirming the order contents through voice output and voice recognition.

The processing of the order details may include: transmitting the order information to a terminal installed in a kitchen; And it characterized in that it comprises a step of confirming the order processing from the kitchen terminal.

Here, through the audio input / output device using the artificial intelligence assistant function to process the payment by using the customer's information recognized by speech recognition, provide sales information and mileage information of the customer, and the customer information contained in the database The method may further include updating.

According to the present invention, an artificial intelligence speaker having an artificial intelligence function related to speech recognition and speech synthesis can be processed by receiving an order from a customer at a store.

In addition, it is possible to provide the customer with customized information by using an artificial intelligence speaker having an artificial intelligence function related to speech recognition and speech synthesis.

In addition, it is possible to promote sales by attracting customers by using an artificial intelligence speaker having an artificial intelligence function related to speech recognition and speech synthesis.

1 is an exemplary diagram of a smart ordering system according to an embodiment of the present invention.
2 is a block diagram of audio processing according to an embodiment of the present invention.
3 is a block diagram of a POS terminal included in the smart ordering system of FIG. 1.
4 is a flowchart of a smart ordering method according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of a smart ordering system and method will be described in detail with reference to the accompanying drawings.

Like reference numerals in the drawings denote like elements. In addition, specific structural to functional descriptions of one embodiment of the present invention are only illustrated for the purpose of describing the embodiment according to the present invention, and unless otherwise defined, all terms used herein including technical or scientific terms are used. The terms have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and are not construed in ideal or excessively formal meanings unless expressly defined herein. It is preferable not to.

Hereinafter, a smart ordering system according to an embodiment of the present invention will be described.

Smart ordering system according to an embodiment of the present invention is implemented in the form of a kiosk (unmanned automatic ordering device) equipped with a display device for displaying menu information and order steps with a picture in a large store such as a food court, or a general cafe Alternatively, the present invention may be implemented in a form including an audio input / output device and a POS terminal installed at a customer table arranged in a restaurant, and the customer table may be further provided with a display device for displaying menu information and order steps together with a picture. .

In particular, the smart ordering system according to an embodiment of the present invention is suitable for a task of receiving an order via voice from a user who is not familiar with an automatic ordering device such as a kiosk, one person manages a counter and / or a kitchen, and additional personnel This lack of restaurants or cafes are more suitable for the task of receiving and processing customer reception and customer orders.

1 is an exemplary diagram of a smart order system 1000 according to an embodiment of the present invention.

Referring to FIG. 1, the smart ordering system 1000 according to an exemplary embodiment of the present invention may include a POS terminal 100, an audio input / output device 200, a kitchen terminal 300, and a server 400 as components. ), Database 500, and network 600.

The POS terminal 100 inputs the voice spoken by the customer through the audio input / output device 200 and outputs the voice required to complete the conversation. In addition, the POS terminal 100 may perform a role of identifying an order using a voice recognition result of the input voice.

The input and output voice of the customer voice constituting the conversation with the customer passes through the audio input / output device 200, and the POS terminal 100 controls the process of recognizing the input voice and generating a voice to be output. . In addition, the POS terminal may receive text that is a result of voice recognition, that is, a voice recognition result transmitted from the server 400, for order processing to grasp the order contents and generate order information based on the text. The generated order information is transmitted to the kitchen terminal 300 and receives confirmation. In addition, the POS terminal 100 stores and manages customer information and menu information and performs payment processing. The POS terminal 100 may include an input device 140 such as a keyboard, a mouse, a barcode input device, and an output device 160 such as a display device in a computing device represented by a PC.

The audio input / output device 200 is a device using an artificial intelligence function. The audio input / output device 200 receives a voice in a conversation with a customer and outputs a synthesized voice in response to the voice.

The voice spoken by the customer goes through the preprocessing step and the voice recognition step, and the result of the voice recognition is output as text. Thereafter, the output text is interpreted as a natural language, and the response to the text is processed through the conversation management, natural language generation, and translation stages.

The audio input / output device 200, that is, the AI speaker 200, includes, as a component thereof, a communication interface 210, an audio input interface 220, an audio output interface 230, and a speech synthesis module 240. do. The artificial intelligence speaker 200 may also perform a router function using the communication interface 210. That is, the artificial intelligence speaker 200 may provide a wireless LAN service such as Wi-Fi to the communication terminal of the customer through the communication interface 210. In addition, the audio input / output device 200 may communicate with the POS terminal 100 or directly communicate with the server 400 through the communication interface 210.

The audio input / output device 200 receives a voice of a customer through the audio input interface 220. The audio input interface 220 may be implemented as a microphone. The microphone receives a voice and converts the voice into an electrical signal, and the electrical signal may be streamed or stored as a file to be transmitted to the POS terminal 100 or the server 400. Can be.

The audio input / output device 200 receives a text response from the server 400 to complete a response required for the customer's conversation, and converts the text response required for the customer's conversation into a voice using the speech synthesis module 240. The converted voice is output through the audio output interface 230.

The audio input interface 220 may include, as a component thereof, a plurality of microphones for converting voice or sound into electrical signals. In addition, the audio output interface 230 may include a plurality of speakers for converting an electrical signal into a sound as a component thereof.

The kitchen terminal 300 receives the order information from the POS terminal 100 and transmits a confirmation message indicating that the order information has been confirmed to the POS terminal 100. The POS terminal 100 confirms the confirmation message so that the order contents are transmitted to the kitchen terminal 300. When the food is completed, the kitchen terminal 300 informs the POS terminal 100 of the completion of the food, and the food is served to the customer. In the case of self-cultivation, the fact that the food is completed is delivered to the audio input / output device 200, and the customer may be directly provided with the completed food through the output voice.

The server 400 may include a plurality of servers for each function. For example, the server 400 may include a management server managing the POS terminal 100, a database server managing customer information and menu information, a server providing an artificial intelligence API, and a natural language processing (NLP) API. have.

The server 400 providing the artificial intelligence API and the natural language processing API recognizes the voice of the customer using the artificial intelligence assistant function, generates a text response required for the conversation with the customer, and outputs the audio input / output device 200. Or to the audio input / output device 200 through the POS terminal 100.

2 is a block diagram of audio processing according to an embodiment of the present invention.

Referring to FIG. 2, a process related to audio processing performed through the audio input / output device 200 and the server 400 is illustrated. The audio input / output device 200 converts a voice signal input through the audio input interface 220 into an electrical signal, transmits it to the server 400, and outputs a response composing a conversation. The text response received from the server 400 is converted into voice and output.

The server 400 may include a speech recognition server and a natural language processing server for each function. The voice recognition server 400 recognizes the voice using the voice data received from the audio input / output device 200 and outputs the voice recognition result in text form, and transmits the result to the conversation natural language processing server 400. The natural language processing server 400 outputs a text response through natural language interpretation, conversation management, natural language generation, and translation using the speech recognition result. The output text response is transmitted to the audio input / output device 200. Although the speech synthesis process may be performed by the server 400, it is preferable that the audio input / output device 200 receives a test response having a smaller capacity than the speech file and synthesizes the speech response. In addition, the speech synthesis, which does not have a relatively large computing capacity, is performed by the audio input / output device 200 or the POS terminal 100 rather than the server 400, and as a result, the synthesized speech is finally output to the audio input / output device 200. Can be output through the speaker.

The server 400 may include a data / knowledge base 420, and the data / knowledge base 400 may mechanically analyze natural language and make it in a form that can be understood by a computer, or by which a human may understand the processing result of the computer. It can include various engines, dictionaries, and knowledge bases that are related to natural language processing, which is the technology of making a language.

The database 500 is constructed, stored and managed using various data collected through the POS terminal 100 in operating a store such as customer information, order information, and sales information.

In particular, the customer information may include the visit history and order history of the customer. In running a restaurant, making a good impression on the restaurant is very important to the promotion. In other words, what makes customers think they are being cared for in providing services to customers is to have an active customer who can directly lead to sales by attracting other customers, not just potential customers. Providing attention to these customers often encounters limitations in the head of one person, for example, the owner or chef. Therefore, it is possible to store and manage customer information for expressing interest in the customer and lead a conversation with the customer through the audio input / output device 200 of the artificial intelligence function based on the customer information.

In addition, the menu information may include special menu information in addition to the general menu. The special menu corresponds to a special menu organized by day. In the case of restaurants such as Japanese restaurants and sushi restaurants, the supply of food materials may vary depending on the season. Therefore, special menu information using a special food material supplied on a specific day may be included in the menu information and provided to the customer. The food materials and the special menu information using the same are input by the user through the POS terminal 100 on a daily basis, or when the restaurant or cafe in which the POS terminal 100 is installed is in the form of a chain store, the POS terminal 100 manages the management server 400. Food material and special menu information using the same can be provided from.

For example, the customer information may include the date the customer last visited and the menu information ordered at the time. The POS terminal 100 uses the AI assistant function to communicate with the customer based on the date of the last visit by the customer through the audio input / output device 200 and the menu information ordered at the time, conversations using the customer visit history, and customer order. By using the history in conversations, you can naturally provide special menu information and lead it to orders.

The network 600 may be a wired and wireless network, such as the Internet, intranets and extranets, cellular systems such as 3G mobile, GSM, WCDMA, CDMA 2000, LTE, 5G mobile, LAN, WAN, WiFi networks, It may be any suitable communication network, including ad hoc networks and combinations thereof.

Network 600 may include a connection of network elements such as hubs, bridges, routers, switches, and gateways. Network 600 may include one or more connected networks, such as a multi-network environment, including a public network such as the Internet and a private network such as a secure corporate private network. Access to network 600 may be provided through one or more wired or wireless access networks.

Hereinafter will be described in detail with respect to the POS terminal 100 according to an embodiment of the present invention.

3 is a block diagram of a POS terminal included in the smart ordering system of FIG. 1.

Referring to FIG. 3, the POS terminal 100 controls the conversation process with the customer through the audio input / output device 200, and displays the order contents based on the voice recognition result of the voice spoken by the customer during the conversation. Identify, generate order information, and finally process the order.

POS terminal 100 is a component thereof, order processing module 110, information management module 120, payment processing module 130, input device 140, output device 160, storage device 170, Communication device 180 and power supply device 190.

The order processing module 110 identifies the order through the voice recognition result of the conversation contents, generates order information, delivers the generated order information to the kitchen terminal 300, and checks the delivery result. In addition, it serves to receive a message about the completion of food from the kitchen terminal 300 or to inform the message through the audio input / output device 200.

The order information may include a menu name, quantity, table number, and customer number in the case of a registered customer. The order processing module 110 may conduct a conversation using customer information and menu information using an artificial intelligence function through the audio input / output device 200. In addition, the name of the menu ordered by the customer and the quantity of the order are grasped to generate order information and transmit the same to the POS terminal 100.

The information management module 120 stores and manages customer information and menu information. In more detail, the information management module 120 builds and manages a database 500 including customer information and menu information. The customer information includes information about the visit history of the customer and the menu history ordered, including the identity of the registered customer. The menu information includes not only food or beverage information that can be serviced to the customer, but also special menu information organized on a daily basis according to seasonality of the food materials. Examples of the special menu information include drinks using seasonal fruits such as strawberries, watermelons, peaches, and food menu information using sushi, sashimi, mushrooms, or fresh vegetables using fresh seafood and fish.

The payment processing module 130 serves to perform a payment processing function of the POS terminal 100. In particular, when the payment time can be determined through a conversation with a customer through the audio input / output device 200, and information about the payment time is transmitted to the POS terminal 100 through the audio input / output device 200, The POS terminal 100 processes payment for an order through the payment processing module 130. When the voice of the customer through the audio input / output device 200 is recognized, the payment processing module 130 may perform a payment using a registered payment means. Detailed description of payment through voice recognition by artificial intelligence using characteristics of frequency, amplitude, and tone of customer voice will be described later. The input device 140 receives various commands required for ordering and payment according to a user's input. The input device 140 may be implemented by a keyboard, a touch screen, a mouse, an electronic pen, a barcode input device, and the like, but is not limited thereto.

The output device 160 may be implemented by a display device that outputs sales status, table status, customer order status, order processing result, and the like.

The storage device 170 may store the database 500 constructed by using customer information and menu information necessary for sales management.

The communication device 180 includes a device for short range wireless communication, wireless data communication, and wireless voice communication in addition to wired data communication. Specifically, the communication device 180 includes a communication module corresponding to various communication networks of the network 600, for example, a Bluetooth module, a Wi-Fi module, an Ethernet interface card, a USB module, a cellular wireless communication module, a modem, and a wireless router. However, it is not limited thereto.

The power supply unit 190 includes, but is not limited to, a power supply for converting AC into DC, an adapter, SMTP, various secondary batteries, and a primary battery.

Preprocessing of speech, speech recognition, natural language interpretation, conversation management, natural language generation and translation services provided by the server 400 is characterized by the use of artificial intelligence AIP and natural language processing API. Therefore, in order to process operations related to machine learning or deep learning, an open API provided by the server 400 may be used. However, a chat or conversation performed by an AI speaker using an AI assistant function in a restaurant or a cafe may be used. In many cases, the operation of processing a voice is not complicated in that the chat structure is simple and the conversation is conducted for the purpose of menu selection. Accordingly, the artificial intelligence and natural language processing API 410 may be provided at the server 400 or may be stored and serviced in a local area of the POS terminal 100, that is, the storage device 170.

The preprocessing module 411 removes noise from the input sound, extracts a human voice, and performs a voice preprocessing function for amplifying and converting the voice. The voice recognition module 412 performs a voice recognition function of converting the voice signal received from the preprocessing module 411 into text. The natural language analysis module 413 interprets the meaning of the natural language included in the text. The dialogue manager 414 determines the best dialogue strategy for the intention of the user speech in consideration of the dialogue flow and the situation to generate the meaning and expression of the system speech. The natural language generation module 415 then generates a natural language text response that includes the meaning and expression generated by the conversation manager 414 as a response to the natural language. In addition, the translation module 416 translates natural language text responses into foreign languages.

Finally, the voice synthesis module 240 converts the natural language text response into a voice of a preset tone and outputs the voice. In particular, the speech synthesis module 240 is characterized in that it is included in the audio input / output device 200, but is not necessarily limited thereto, and may be included in an artificial intelligence and natural language processing API provided by the server 400.

In the configuration of the artificial intelligence and natural language processing API 410 of the audio input / output device 200, the POS terminal 100, and the server 400 illustrated in FIG. 3, each device or module is functionally divided for convenience of description. In one configuration, hardware may be configured as a logical function processed by one processor, and the present disclosure is not limited to the presented divisions.

In addition, although the connection relationship between each configuration is shown as a connection line, or the connection relationship between each other is not expressed individually, communication or transmission for control or data exchange may occur even between the configuration where the connection line is not shown, and only as shown. It does not limit the invention.

Hereinafter, a smart ordering method according to an embodiment of the present invention will be described.

4 is a flowchart of a smart ordering method according to an embodiment of the present invention.

Referring to FIG. 4, the smart order method S100 includes steps S110 to S140.

Smart order method according to an embodiment of the present invention (S100) is a POS terminal 100 through the artificial intelligence speaker 200 utilizing the artificial intelligence assistant function to supplement the manpower in the lack of food court, food or cafe, etc. As a method of performing the service, the service may be provided using only voice alone, or voice information may be provided together with the display through the display device of the kiosk apparatus.

In the smart order method (S100) according to an embodiment of the present invention will be described by way of example an order method that can be utilized in restaurants or cafes provided with a customer table.

First, a dialogue between an audio input / output device 200 and a customer is performed (S110). That is, the POS terminal 100 recognizes a voice spoken by a customer using the audio input / output device 200, responds to a question of the customer, talks with the customer using the customer's personal information, and a menu to be ordered by the customer. In order to improve the information and accept the order, a voice is inputted and an audio input / output device using an artificial intelligence function that outputs the synthesized voice is used to communicate with the customer.

In particular, the POS terminal 100 may recognize the customer by using the previously stored customer information for the registered customer (S111), check the customer information for the unregistered customer, and register the customer (S112).

In addition, the POS terminal 100 may perform a customized conversation for each customer by using customer information including information about a visit, an order history, and a reservation of a customer through a built database. The so-called loyal customers are loyal customers for restaurant owners, and loyalty customers have a lot to do with sales promotion. The management of these loyal customers, which were managed based on human memory in the past, can also be managed using the AI assistant function through the establishment of customer information.

In addition, the POS terminal 100 may provide customized menu information by using menu information regarding a special menu organized by day in accordance with the supply and demand situation of food materials according to the customer information and the season through the established database. In addition to the customer information, information about a special menu that may be provided to the customer may be managed in the form of special menu information. An example of the special menu may be a food menu using seasonal fruits, seasonal vegetables, and seafood that are supplied differently depending on the season as described above.

Next, order information is generated based on the dialogue with the customer (S120). That is, the POS terminal 200 generates order information including the table number, the customer number, and the order contents according to the conversation contents with the customer.

Here, in step S120, the step of determining the order contents based on the conversation contents with the customer (S121); And checking the order contents through voice output and voice recognition (S122).

The order contents are understood from the conversations spoken by the customer. The conversation content spoken by the customer is voice recognized and the result is transmitted to the POS terminal through the server 400 in text form. The POS terminal 100 grasps the menu name and quantity from the text. In addition, the POS terminal 100 may output a voice confirming the order contents to the customer through the audio input / output device 200, and finally confirm the order contents by recognizing the answer voice spoken by the customer. The POS terminal generates order information based on the confirmed contents.

Next, the order history is processed (S130).

Here, in step S130, delivering the order information to the terminal installed in the kitchen (S131); And it may include a step (S132) to confirm the order processing from the kitchen terminal. The POS terminal 100 transmits the order information to the kitchen terminal 300, and if a confirmation of the order information is confirmed by the manpower in the kitchen, a confirmation message is transmitted to the POS terminal 100 and the order is processed.

Finally, payment by voice recognition is performed, sales information is provided to the customer, and customer information is updated (S140).

Payment of the food price according to a general method, not by voice recognition may be performed through the artificial intelligence speaker 200 and the POS terminal 100 installed in the seat where the customer sits. For example, when a customer requests a seat payment, the AI speaker 200 may call a manager who is waiting at the counter to the seat of the customer through the POS terminal 100. Alternatively, in the case of a registered customer, payment is made using a registered payment method, for example, by using registered credit card information by transferring the recognized customer's customer information to the POS terminal 100 through the artificial intelligence speaker 200. Can be performed. And when the customer ordered food through the AI speaker 200 installed in the kiosk, the food price can be prepaid at the time of order.

In addition, payment may be processed through the payment processing module 130 by voice recognition, that is, using the audio input / output device 200. For example, if the credit card information of the customer is already stored in the POS terminal 100 by the one-time payment experience, as long as the identity of the customer is determined by the voice input function of the audio input / output device 200, Payment may be performed using credit card information stored in advance by input.

The voice of a person input through the audio input / output device 200 is defined as one sound. And the three elements that characterize sound are frequency, amplitude, and timbre. Frequency is related to the pitch of the note, amplitude is related to the loudness, and tone is one of the characteristics of the note.

Accordingly, when the input voice signal of the customer is stored in a data file through digital conversion, that is, sampling, quantizing, and encoding, a model for identifying the voice of the customer is generated. Through the artificial intelligence learning function, the customer's characteristics are learned through the model by playing the stored customer's voice file. Using this process, it is possible to recognize a customer's voice using artificial intelligence and to process a payment using the recognized customer's personal information. Importantly, since the characteristics of the human voice are not limited to the timbre, but the frequency, the amplitude, and the timbre, all the characteristics of the frequency, the amplitude, and the timbre can be used for customer recognition by the voice.

Care can be performed after the customer has finished eating. For example, the sales information, various coupon information, or mileage information secured by the customer may be provided to the customer through the audio input / output device 200 through a conversation with the customer.

When the payment is completed, the POS terminal 100 updates and stores the visit and menu information of the customer in the customer information.

As described above, according to an embodiment of the present invention, an artificial intelligence speaker having an artificial intelligence function related to voice recognition and speech synthesis may receive and process an order from a customer at a store.

In addition, it is possible to provide the customer with customized information by using an artificial intelligence speaker having an artificial intelligence function related to speech recognition and speech synthesis.

In addition, it is possible to promote sales by attracting customers by using an artificial intelligence speaker having an artificial intelligence function related to speech recognition and speech synthesis.

The smart order method S100 according to an embodiment described with reference to the drawings may be implemented in the form of a recording medium including a command set executable by a computer, such as a program module executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery media.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. .

100: POS terminal
110: order processing module
120: customer information management module
130: payment processing module
140: input device
150: output device
160: storage device
170: communication device
180: power supply
200: audio input / output device, AI speaker
300: kitchen terminal
400: server
411: pretreatment module
412: speech recognition module
413 natural language interpretation module
414: conversation manager
415: natural language generation module
416: translation module
500: database
600: network
1000: smart ordering system

Claims (14)

An audio device that utilizes an intelligent personal assistant function, which processes speech recognition for a voice spoken by a customer, responds to a customer's question, and communicates with a customer using the customer's information and provides menu information. An audio input / output device configured to receive a voice and output a synthesized voice in a process of receiving a voice; And
Based on the text information transmitted from the speech recognition server that processes speech recognition and / or the natural language processing server that manages the conversation, the speech about the conversation with the customer is synthesized and output through the audio input / output device, and ordered from the conversation contents. Smart order system, characterized in that it comprises a POS terminal to grasp. The method according to claim 1,
The audio input / output device,
An audio input interface for receiving a voice signal and converting the data into data and an audio output interface for outputting a synthesized voice signal using text generated according to natural language processing; And
Smart order system comprising a communication interface capable of two-way communication with the speech recognition server, natural language processing server and the POS terminal. The method according to claim 1,
The POS terminal,
And an order processing module for generating order information after checking the identified order contents through voice output and voice recognition. The method according to claim 3,
The POS terminal,
Smart order system, characterized in that for transmitting the order information to the kitchen terminal through the order processing module, and confirms the order processing from the kitchen terminal. The method according to claim 1,
The POS terminal,
An information management module that builds and manages a database of customer information including information on visits, orders and reservations of customers, and a menu information database containing daily special menu information organized according to the season of supply and demand of food materials. Smart ordering system comprising a. The method according to claim 5,
The POS terminal,
Smart order system, characterized in that to lead the customer-specific conversation by providing the customer information to the natural language processing server or by using the customer information to complete the text information transmitted from the natural language processing server. The method according to claim 5,
The POS terminal,
And providing customized menu information for each customer by providing the special menu information to the natural language processing server or completing text information transmitted from the natural language processing server using the special menu information. Recognizes voices spoken by customers, responds to customer's questions, communicates with customers using customer's personal information, provides information on menus to be ordered by customers, and outputs synthesized voices to receive orders Conducting a conversation with a customer through an audio input / output device using an artificial intelligence function;
Generating order information including the table number, the customer number, and the order contents according to the conversation contents with the customer; And
And processing the order details to confirm order information delivery and information delivery. The method according to claim 8,
Proceeding with the customer,
And recognizing the customer using the pre-stored customer information for the registered customer, confirming the customer information for the unregistered customer, and registering the customer. The method according to claim 9,
Proceeding with the customer,
Smart order method comprising the step of conducting a customer-specific conversation using the customer information, including the information on the visit and order history and reservation of the customer through the established database. The method according to claim 10,
Proceeding with the customer,
Smart order method comprising the step of providing the customized menu information by using the menu information on the special menu organized by day in accordance with the customer information and seasonal supply and demand of food materials through the established database. The method according to claim 8,
Generating the order information,
Identifying the order contents based on the conversation contents with the customer; And
And confirming the order contents through voice output and voice recognition. The method according to claim 8,
Processing the order history,
Transmitting the order information to a terminal installed in a kitchen; And
Smart order method comprising the step of confirming the order processing from the kitchen terminal. The method according to claim 8,
An audio input / output device using the AI assistant function is used to process payments using customer information recognized by voice recognition, provide sales information and customer mileage information, and update customer information contained in a database. Smart order method, characterized in that it further comprises a step.

Images