KR20220149380A - A method to identify a food menu using artificial intelligence-based speech recognition and a system using the same - Google Patents

Abstract

According to the present invention, provided is a method for identifying a delivery address using speech recognition, as a recognition module is included in an AI callbot system and a recognition module for recognizing a delivery address has been trained, comprising the steps of: (a) receiving, by a call center infrastructure system, an order call from a terminal of a consumer; (b) receiving, by the AI callbot system, the order call from the call center infrastructure system, and using the recognition module to check a delivery address included in the order call; (c) registering, by the AI callbot system, an order sheet including the delivery address in a cloud order system; (d) receiving, by an in-store POS terminal, the order sheet from the cloud order system, and displaying information included in the order sheet on a screen for a preset time so that an in-store person in charge can confirm the order; and (e) if the order is not confirmed during the preset time, automatically canceling the order call and if the order is confirmed during the preset time, printing, by the POS terminal, the order sheet using an in-store printing device and transmitting the information included in the order sheet to a delivery agency device. Therefore, the speech recognition rate for a delivery address is increased.

Description

A METHOD TO IDENTIFY A FOOD MENU USING ARTIFICIAL INTELLIGENCE-BASED SPEECH RECOGNITION AND A SYSTEM USING THE SAME

The present invention relates to a method of identifying a delivery address through artificial intelligence-based voice recognition, wherein a recognition module is included in the AI callbot system, and in a state in which the recognition module for recognizing the delivery address is learned, the call center infrastructure system, receiving an order call from a consumer's terminal; The AI callbot system, receiving the order call from the call center infrastructure system, and using the recognition module to check the delivery address included in the order call; registering, by the AI callbot system, an order book including the delivery address in the cloud order system; The in-store POS terminal receives the order form from the cloud order system, and displays the information included in the order form on the screen for a preset time so that the in-store person in charge confirms the order; and if there is no order confirmation for the preset time, the order call is automatically canceled, and when the order is confirmed for the preset time, the POS terminal prints the order form through an in-store printer, It relates to a method comprising the step of passing the included information to a delivery agency device.

The domestic delivery market is growing rapidly with an estimated market size of KRW 28 trillion in 2021 and an average annual growth rate of 12.3%. Although delivery orders are increasing through delivery apps, the proportion of orders made over the phone is still high.

Currently, in the case of a phone order by a commercialized AI speaker or AI voice assistant, it performs voice recognition over a wide area and shows a low recognition success rate. As a result, there was an aspect in which an active response was impossible in case of an emergency. In addition, there is a limit to voice recognition, so an AI delivery service that specializes in recognition areas such as menus and addresses and shows a high recognition success rate was needed.

Accordingly, the present inventor intends to propose a method and a system using the same for voice recognition of a delivery address after identifying a food menu through voice recognition.

An object of the present invention is to solve all of the above problems.

Another object of the present invention is to have a high voice recognition success rate of a delivery address through an AI call bot for a consumer's voice included in a delivery call.

Another object of the present invention is to improve the speech recognition rate corresponding to the standard address by comparing the speech recognized address with the standard address.

In order to achieve the object of the present invention as described above and to realize the characteristic effects of the present invention to be described later, the characteristic configuration of the present invention is as follows.

According to an aspect of the present invention, the recognition module is included in the AI callbot system, and in the state that the recognition module for recognizing the delivery address is learned, (a) the call center infrastructure system receives the order call from the consumer's terminal Step, (b) the AI callbot system receives the order call from the call center infrastructure system, and uses the recognition module to check the delivery address included in the order call, (c) the AI callbot system includes the delivery address Registering the order form in the cloud order system, (d) the in-store POS terminal receives the order form from the cloud order system and displays the information included in the order form on the screen for a preset time so that the in-store person in charge can confirm the order and (e) if there is no order confirmation for a preset time, the order call is automatically canceled. A method of identifying a delivery address through voice recognition is provided, comprising the step of delivering the received information to a delivery agency device.

According to the present invention, the following effects are obtained.

The present invention has the effect of having a high speech recognition success rate for the delivery address through the AI call bot for the voice of the consumer included in the delivery call.

The effect of the present invention is not limited thereto.

1 is a diagram illustrating a schematic configuration of a system for providing an order automation service using a method of identifying a delivery address through voice recognition according to an embodiment of the present invention.
2 is a flowchart illustrating a method of identifying a delivery address through voice recognition according to an embodiment of the present invention.
3 is a view for explaining a method of identifying a delivery address through voice recognition according to an embodiment of the present invention.
4 is a diagram illustrating a screen of a backup counselor terminal supported by a backup counseling server according to an embodiment of the present invention.
5 is a diagram illustrating information that can be checked in an integrated management system according to an embodiment of the present invention.
6 is a diagram showing a detailed configuration of a system for an order automation service according to an embodiment of the present invention.
7 is a view showing the progress of the AI ordering service according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0014] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0016] Reference is made to the accompanying drawings, which show by way of illustration specific embodiments in which the present invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the present invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein with respect to one embodiment may be implemented in other embodiments without departing from the spirit and scope of the invention. In addition, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the detailed description set forth below is not intended to be taken in a limiting sense, and the scope of the present invention, if properly described, is limited only by the appended claims, along with all scope equivalents to those claimed. Like reference numerals in the drawings refer to the same or similar functions throughout the various aspects.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily practice the present invention.

1 is a diagram illustrating a schematic configuration of a system for providing an order automation service using a method of identifying a delivery address through voice recognition according to an embodiment of the present invention.

2 is a flowchart illustrating a method of identifying a delivery address through voice recognition according to an embodiment of the present invention.

As can be seen in Figure 1, in the overall system of the present invention, AI callbot system 100, call center infrastructure system 200, backup consulting server 300, cloud ordering system 400, POS terminal 500, delivery agency device 600 and the like, and an order automation service may be provided using each of them. A detailed structure of each system will be described with reference to FIG. 6 to be described later, and processes performed in each system will be described below. However, in the POS terminal 500, both a service solution in the form of an app or web with the same function installed in a separate terminal and a general smart phone are possible.

First, a consumer (customer) may request an order using a terminal (phone). The call center infrastructure system 200 may receive an order call from the consumer's terminal (S210). Here, the order call corresponds to a call (call) for requesting delivery of food, etc. sold in the store.

Next, the AI callbot system 100 may receive the order call from the call center infrastructure system 200 and confirm the delivery order included in the order call using the recognition module 110 ( S220 ).

The recognition module 110 included in or linked to the AI callbot system 100 includes an AI engine and the like, and can support AI-based voice recognition technology through this. For reference, the AI engine may include a speak to text (STT) engine, a text to speak (TTS) engine, or a hybrid engine that considers all of the STT function, TTS function, and NLP (Natural Language Process) function.

Specifically, the AI callbot system 100 may recognize the food menu and delivery address included in the order call through the recognition module 110 . However, in the present invention, the recognition of the delivery address will be focused on. In order to increase the accuracy of food menu recognition, iterative learning should be performed in advance for the recognition module 110, and the learning process will be described below.

When the address recognition method using the AI of the recognition module 110 is described in detail, the recognition module 110 may identify the delivery address by extracting the delivery address from the consumer's voice data.

The consumer may say a delivery address and food menu for ordering, and the consumer's voice may be converted into voice data by the AI callbot system 100 . In addition, the recognition module 110 may perform AI voice recognition using voice data, and may generate text data. The recognition module 110 may identify and extract a delivery address and a food menu from text data, respectively. For example, the recognition module 110 may recognize 'SK View 3rd apartment building, XX-dong XXXX, Haengsin-dong, Deogyang-gu, Goyang-si, Gyeonggi-do' as a delivery address and extract it separately from the food menu.

Subsequently, the recognition module 110 may separate the delivery address into a basic address and a detailed address. A basic address is a part that can correspond to a standard address, and it is a part of the delivery address that includes phrases such as city, province, gu, dong, etc. can The detailed address is a detailed address other than the basic address among the delivery addresses, and may be a floor, a lake, etc. for a detailed delivery location in a building specified as the basic address. In this case, the standard address may mean a standard address provided by the Ministry of Public Administration and Security.

In the delivery address recognized in the example above, the recognition module 110 may correspond to the 'SK View 3rd apartment in Haengsin-dong, Deokyang-gu, Goyang-si, Gyeonggi-do' may correspond to the basic address, and 'No. XX-dong XXXX' may correspond to the detailed address. .

According to an embodiment, the recognition module 110 may identify a Korean recognition part for English included in the basic address, and replace the Korean language recognition part for English with English. Specifically, the consumer may utter the name of a building made in English, the English name may be voice recognized in Korean, and the English part recognized in Korean may mean the Korean recognition part for English. For example, the consumer may utter 'SK view', and the recognition module 110 may recognize it as 'SK view'. In the recognition module 110, 'SK' in 'SK View' may be a Korean recognition part for English. The recognition module 110 may replace the Korean recognition part for English into English, and thus, 'SK view' may be replaced with 'SK view'.

Also, the recognition module 110 may identify a space error part included in the base address and correct the space error part. In recognizing the consumer's voice, the recognition module 110 may distinguish a portion where the voice is recognized as a sound of a recognizable size and a portion where the recognition is stopped to distinguish spaces in the delivery address. The part where speech recognition is stopped and speech is not performed may have different spacing compared to the actual standard address. For example, the delivery address recognized by the recognition module 110 may include 'SK view tertiary apartment', but the actual standard address may be 'SK view tertiary apartment'. The recognition module 110 may identify a space error part of the reference address through comparison with the standard address and correct the space error part. Accordingly, the 'SK view tertiary apartment' part can be modified to 'SK view tertiary apartment'.

In addition, the recognition module 110 may identify the Korean recognition part of the special symbol included in the basic address, and replace the Korean recognition part of the special symbol with the special symbol. The recognition module 110 may recognize a special symbol such as '-' as an uttered sound and convert it into a character such as 'again' in the process of changing it into a character. For example, the base address may include '123 again 12', and the recognition module 110 may recognize 'again' as a special symbol. Accordingly, the recognition module 110 may modify '123 again 12' to '123-12' by replacing 'dash' with a special symbol '-'.

Subsequently, the recognition module 110 may compare the base address with a standard address list of an address application programming interface (API). The address API may mean a language or message format for a standard address provided by the Ministry of Public Administration and Security. The recognition module 110 may identify a standard address corresponding to the basic address by comparing the standard address list with the basic address.

According to an embodiment, the recognition module 110 may cluster the standard address list into addresses within a preset distance range based on the address of the store. The recognition module 110 may designate a range within a preset distance, for example, 10 km, based on the location corresponding to the address of the store, and may cluster all standard addresses within the preset range and classify them as one data unit. have.

Then, the recognition module 110 may compare the base address with the clustered standard address list. The recognition module 110 may preferentially compare standard addresses formed by clustering in a distance range set in advance based on the location of the store with the basic address in the process of comparing the delivery address and the standard address received in the store. The standard address may be clustered around the store address by using the characteristic that the consumer will order from a store adjacent to the delivery address, and thus, the accuracy of identifying the standard address may be further improved.

According to an embodiment, a range for clustering standard addresses, ie, a distance for determining a range centered on a store, may be changed based on the consumer's past order data. More specifically, the AI callbot system 100 may access the consumer's past order data, and may calculate the distance between the consumer's delivery address and the store where the delivery order was placed. The AI callbot system 100 may calculate the average value of the distance between the delivery address and the store, and calculate the clustering range centered on the store by multiplying the average value of the calculated distance and a preset multiple value (eg, 1.5) can do. For example, the average value of the distance between the delivery address and the store calculated using data that a specific consumer has ordered delivery in the past may be 5 km, and the AI callbot system 100 sets a preset multiple of 1.5 to 5 km. Multiply this to yield a clustering range of 7.5 km. In this case, the recognition module 110 may form a cluster of all standard addresses that exist within a distance of 7.5 km from the location of the store, and compare the clustered standard address list with the basic address to obtain the basic address. A corresponding standard address can be identified.

According to an embodiment, when the AI callbot system 100 compares the basic address with the standard address list of the API, the area adjacent to the store is in a preset address unit based on the store address, for example, in a gu or dong unit. can be configured to cluster addresses within the region. That is, it is possible to minimize the search error by limiting the address search to the area determined as the delivery destination in the store in a unit of address set based on the store address, for example, in a gu or dong unit (S230). For example, there may be a plurality of Samsung apartments in the country, but the number may be smaller when viewed in a dong unit, for example, since there may be only one, the problem of duplication can be minimized.

According to an embodiment, the recognition module 110 may identify a standard word included in the standard address list, and form a list of similar words for the standard word. In addition, the recognition module 110 may identify a word that does not match a standard word of the standard address list among the basic addresses, and compare the word with the similar word list. A standard address may consist of a plurality of standard words. For example, in the standard address 'Building A', 'building' may be a standard word. Recognition module 110 may recognize 'A tower' as a basic address by voice recognition, 'A' part of the basic address matches 'A' part of the standard address, and 'Tower' part of the basic address is It can be determined that the standard address does not match the standard word 'building'. The recognition module 110 may compare the 'tower' part of the base address that does not match the standard word 'building' with a list of similar words of the standard word. The standard word similar word list may be a list collected through statistical data analysis of a plurality of words similar to the standard word, and the standard word similar word list of 'building' may include 'tower'. The recognition module 110 may confirm that 'tower' of the base address is included in the list of similar words of 'building', which is a standard word, and in this case, 'tower' of the base address is replaced with 'building', which is a standard word. can

Subsequently, the recognition module 110 may identify a standard address corresponding to the base address from the standard address list, and replace the base address with the standard address. The recognition module 110 may identify the standard address corresponding to the base address using the method described above, and may replace the base address with the standard address. Accordingly, the delivery address may have an address system corresponding to the standard address system.

Subsequently, the recognition module 110 may combine the standard address and the detailed address to complete the delivery address.

According to an embodiment of the present invention, the call center infrastructure system 200 enables multiple phone orders in one store, so that when a plurality of consumers place an order by phone in one store at the same time, it is possible to place a simultaneous call order rather than a call. can support This is because the AI callbot system 100 can automatically respond to an order call received in the call center infrastructure system 200 .

According to an embodiment of the present invention, when the AI callbot system 100 determines that the delivery order is recognized, the delivery order is transmitted to the consumer's terminal and verified, and based on this, the order book including the delivery order is cloud It can be registered in the order system (400).

Conversely, when it is determined that the AI callbot system 100 does not recognize the delivery order, it displays an order screen (visible ARS) on the consumer's terminal, and obtains the delivery order based on the input value from the consumer's terminal. have.

Specifically, in a state where the order screen is displayed on the consumer's terminal, the AI callbot system 100 may obtain a delivery order based on an input value input from the consumer's terminal. When the accuracy of voice recognition using the recognition module 110 is low, the AI callbot system 100 may support obtaining an accurate delivery order using the order screen (visible ARS).

That is, the AI callbot system 100 recognizes the base address from the consumer's voice and provides a pre-stored voice corresponding thereto, that is, a voice that confirms whether the standard address corresponding to the base address is correct, so as to communicate with the consumer by voice. may proceed. In addition, in some cases, the basic address is recognized through the consumer's voice and a corresponding visible ARS screen (a display requesting confirmation that the standard address corresponding to the basic address is correct on the screen of the consumer terminal) is provided so that the consumer can use the voice Alternatively, by input (ex terminal touch, etc.), the AI callbot system 100 may proceed with the conversation by displaying the changing order screen.

4 is a diagram illustrating a screen of a backup counselor terminal supported by a backup counseling server according to an embodiment of the present invention.

According to one embodiment, the AI callbot system 100 is the delivery menu or delivery address based on the pre-stored delivery menu (pre-stored for food sold at each store) and the pre-stored address (on the standard address DB of the Ministry of Public Administration and Security). If it is recognized that it is unclear, a support request message may be transmitted to the backup consultation server 300 .

The backup consultation server 300 says that the recognition is unclear among the information about the customer and the store who made the order call ('1' in the drawing), the connection step, the delivery menu recognition step using the AI engine, and the delivery address recognition step using the AI engine. The determined specific step ('2' in the drawing), delivery information including delivery or packaging ('3' in the drawing), the recognized delivery menu order product ('4' in the drawing), the recognized delivery menu and recognition The payment amount based on the delivered delivery address ('5' in the drawing), the recognized delivery address ('6' in the drawing), the consumer's order history using the order call ('7' in the drawing), included in the order call At least one of a consultation conversation between the consumer and the AI engine may be displayed on the screen of the terminal of the backup agent.

First, the information on the consumer and the store who made the order call may include a telephone number of the consumer (customer), a store branch name, and the like. In addition, on the screen of the terminal of the backup agent, the AI counseling departure step includes a connection step, a menu recognition step, and an address recognition step, and among them, communication connection is difficult or voice recognition is unclear in the process of processing an order call. The determined specific step may be displayed. That is, it indicates whether an error occurred at any stage.

Here, the connection step may mean a case in which an error occurs in the connection (communication) process between the consumer's terminal and the AI callbot system 100, and in some cases, may not be included in the specific step.

In addition, as delivery information, whether it is a package order or a delivery order may be included and displayed, and an AI voice-recognized order product, AI voice-recognized delivery address, etc. may be displayed on the consumer's terminal. The backup consultation server 300 may support the backup agent to change/add/delete orders for products and delivery addresses.

In addition, in the case of the payment amount displayed on the consumer's terminal, the delivery cost based on the location of the address to be delivered as well as the ordered product may be considered.

The consumer's order history using the AI consultation conversation may also be displayed on the consumer's terminal, and the date and time of each AI consultation conversation, whether the consultation was successful, the contents of the consultation conversation, etc. may be included.

In the end, the backup consultation server 300 allows the backup agent to supplement the delivery menu or delivery address based on the order history, whether the AI consultation deviated from which stage, and the conversation between the consumer and the recognition module (AI engine). You can complete your order. For reference, the backup consultation server 300 may perform a supplementary role to the voice recognition method by the AI engine, but in some cases (eg, when a consumer requests, etc.) the voice by the recognition module (AI engine) It is also possible to have the backup agent complete the order form (delivery menu, delivery address, etc.) without realizing it.

The AI callbot system 100 may register an order book including a delivery order (order menu, order address) in the cloud order system 400 ( S240 ). The order menu and order address may correspond to results derived from AI voice recognition or supplementation with a backup consultation server.

In addition, when a customer complains that the delivery is wrong after the ordered food is delivered to the consumer, the function of reproducing the recorded voice file or the recorded text of the phone order is a backup counseling server service or solution (300) You can check the difference between the customer's order and delivery.

In addition, the backup counseling server 300 clearly displays the part that the recognition module 110 has not recognized indefinitely with a separate display in order to shorten the service time, so that the backup counselor does not ask for duplicate voice recognition contents. can do. Specifically, a plurality of recognized delivery menus or an unclearly recognized portion of the delivery address may be displayed together with a separate display (eg, a different color display, a check mark, etc.).

Next, the POS terminal 500 installed in the store may receive an order form from the cloud order system 400 and display information included in the order form on the screen for a preset time.

The POS terminal 500 is a device controlled by a person in charge in the store, and is accessible to the cloud ordering system 400 and the like. In some cases, unlike FIG. 1 , a franchise server may be placed between the cloud ordering system 400 and the POS terminal 500 to support communication between the two.

In addition, the POS terminal 500 may display the information included in the order form on the screen for a preset time so that the person in charge in the store can confirm the order. That is, the POS terminal 500 may pop-up the order food, order place, etc. included in the order form on the screen for a preset time (ex 5 minutes) so that the person in charge in the store clicks the order confirmation button to confirm the order ( S250).

When the information included in the order is in a pop-up state (for a preset time), if there is no order confirmation, the order call is canceled and the pop-up information may also disappear from the screen. In some cases, the store manager may cancel the order call while inputting the reason for canceling the order call (eg, delayed order, exhausted materials, etc.).

When it is confirmed that the order call has been canceled, the AI call bot system 100 or the cloud order system 400 may transmit an order call cancellation message and a reason for cancellation to the consumer's terminal. In addition, it is possible to recommend a menu and a store corresponding to the ordered food that the consumer wants to order. In other words, when the order call is canceled because the order was not confirmed at the store where the order was received, the information on the food ordered by the consumer is used to improve the inconvenience of the consumer who cannot receive the desired food because the order cannot be completed. Thus, a new store and menu can be calculated, and this can be recommended to consumers.

For example, if a consumer orders '1 garlic chicken' from store A, but the order call is canceled, a store that sells 'garlic chicken' or 'whole chicken' among other stores located a certain distance from the customer's delivery address can be recommended. A store that sells the same food (ex garlic chicken) as the food ordered by the consumer may be recommended, but in some cases, a store that sells food (ex whole chicken) that corresponds to a higher concept of the food ordered by the consumer may be recommended. .

However, the recommendation service may not be provided depending on specific cancellation reasons. For example, if it is determined that the customer who ordered is a black consumer, there is no need to recommend another store.

In addition, the recommendation order may be based on a recommendation score (C) calculated based on a preset method (A*x + B*y = C). In the above A*x + B*y = C, A and B correspond to constants, x is the distance from the customer's delivery address to the store, y is the store's evaluation grade (evaluated by customers), and thus the recommendation score C can be calculated.

As a result, the smaller the distance from the delivery address to the store, the higher the evaluation grade of the store, the higher the recommendation score C may be.

Each of A and B of the recommendation score (C) may mean the weight of each of the distance from the delivery address to the store (x) and the evaluation grade (y) of the store. A and B, which are weights of the recommendation score (C), may be changed according to the consumer's past order history. Specifically, by using the consumer's past order history data, the average value of the distance between the consumer's delivery address and the store where they have ordered in the past may be calculated, and the average value of the distance to the store where they have ordered in the past may be compared with a preset distance. When the distance to the store where a previous order is placed is greater than the preset distance, the weight A may increase and the weight B may decrease as the distance to the store where the previous order is greater than the preset distance, that is, the difference value increases. In addition, when the distance to the store where a previous order is placed is smaller than the preset distance, the weight A may decrease and the weight B may increase as the distance to the store where the previous order is placed is smaller than the preset distance, that is, as the difference value increases.

On the other hand, when the information included in the order form is in the pop-up state (for a preset time), when the order is confirmed, the POS terminal 500 prints the order form through an in-store printing device, and the information included in the order form may be delivered to the delivery agency device 600 (S260).

In addition, when the order is confirmed during the preset time, the POS terminal 500 may display a plurality of delivery times and allow the store manager to select a specific delivery time. Among a plurality of estimated delivery times (eg 15 minutes, 20 minutes, 30 minutes, etc.), the store manager selects a specific delivery estimated time.

The POS terminal 500 may print an order book including the selected specific delivery expected time (ex 30 minutes) and transmit an order reception completion message including the specific delivery expected time to the consumer's terminal.

It can be assumed that a plurality of delivery agencies interlocked with the POS terminal 500 exist. The cloud ordering system 400 may deliver a list of delivery agencies in which deliverable manpower exists to the POS terminal 500 in a state in which information on delivery manpower is received in real time from each delivery agent.

The POS terminal 500 allows the person in charge of the store to select a specific delivery agency from the list of delivery agencies, select a specific delivery request time from among a plurality of delivery request times, and specify the order including the specific delivery request time. It can be delivered to the delivery agency device (600).

Here, the delivery request time may mean the time it takes to deliver the cooked food to the order address, and the above-mentioned expected delivery time may correspond to the sum of the time it takes to cook the food and the time it takes to deliver it. have.

Accordingly, a plurality of delivery request times (ex 15 minutes, 20 minutes, 25 minutes, 30 minutes, etc.) displayed on the screen of the POS terminal 500 will be less than or equal to each specific delivery expected time (ex 30 minutes). This is because the delivery time cannot be greater than the sum of the food preparation and delivery times.

In addition, the plurality of delivery request times will be greater than or equal to the time calculated in consideration of the delivery distance and the average delivery speed. Specifically, assuming that the distance from the store to the order address is 15 km and the average delivery speed (based on a scooter) is 60 km/h, the average time calculated as 15 km / 60 km/h will be 15 minutes. That is, the plurality of delivery request times may correspond to a value greater than or equal to 15 minutes.

The POS terminal 500 may display a plurality of delivery request times within the range calculated as above (15 minutes to 30 minutes) on the screen, and allow the store manager to select a specific delivery request time (ex 20 minutes). . In addition, the POS terminal 500 delivers an order book including a specific delivery request time (ex 20 minutes) to the specific delivery agency device 600, and the order menu is delivered to the order place within the specific delivery request time (20 minutes) You can request to be

5 is a diagram illustrating information that can be checked in an integrated management system according to an embodiment of the present invention.

A plurality of stores may use the order automation service of the present invention, and the plurality of stores may receive an order call using the cloud order system 400 . At this time, the cloud ordering system 400 will be accessible through an integrated management system or a web page used by a person in charge of each of a plurality of stores.

In the integrated management system, which is a control tower for managing the order automation service of the present invention, the number of a plurality of first order calls delivered to the cloud order system 400 using AI voice recognition for a preset time, a plurality of first order calls It is possible to check information about the total of the total payment amount, the average call time for a plurality of first order calls, and the like.

For example, you can check information about 200 order calls delivered using AI voice recognition over the past week, total payment amount of 3 million won, and average call time of 50 seconds.

In addition, the integrated management system, the number of the plurality of second order calls delivered using the backup consultation server 300 during the preset time (ex the last week), the total sum of the total payment amount for the plurality of second order calls , it is also possible to check information about the average call time for a plurality of second order calls.

Additionally, the integrated management system recognizes the number of a plurality of third order calls delivered using both the recognition module 110 and the backup consultation server 300, the sum of the total payment amount for the plurality of third order calls, and a plurality of third order calls. 3 You can also check information on average talk time for order calls.

In addition, the number of orders 1-1 to 3-1 during this week (the first week period), the sum of the total payment amounts for orders 1-1 to 3-1 order calls, and 1-1 to Average call time for each of the 3-1 order calls for the past week (2nd week period), the number of order calls 1-2 to 3-2, and the number of order calls 1-2 to 3-2 A changed numerical value (ex %, number of cases) may appear compared to the total of the total payment amount and the average call time for the 1-2 to 3-2 order calls.

In the case of one embodiment, the integrated management system uses the recognition module 110 or the backup consultation server 300 to the number of order calls accumulated up to the preset time (ex. one week) and the total sum of the accumulated payment amount. can also be checked.

In a plurality of stores, the cloud ordering system 400 may be accessed through a web page used by each person in charge. For reference, the login information (eg ID/password, etc.) of the web page and the aforementioned POS terminal 500 may be the same.

On the web page, it is possible to change the price and payment type for products sold by the order call in each store, and support to check the order time, recording history, etc. ordered by the order call. That is, the person in charge of each store can easily modify the price and payment type (packaging or delivery) of the sold product through the web page, and can check the previous details such as order time and recording history.

6 is a diagram showing a detailed configuration of a system for an order automation service according to an embodiment of the present invention.

First, when an order call is received from a terminal of a consumer (customer), the order call is Voice G/W through Server Based Computing (SBC), Session Initiation Protocol (SIP) server, etc. included in the call center infrastructure system 200 . (Gateway) can be reached. The Voice G/W may support AI voice recognition while transmitting and receiving information with the API Server, visible ARS, and STT/TTS/Hybrid engine included in the AI callbot system 100 .

The AI callbot system 100 may perform order menu recognition, order address recognition, etc. included in an order call through the AI engine in the API server, and may acquire affiliate store information, customer information, and the like. For reference, although the ARS and STT/TTS/Hybrid engines shown in FIG. 6 are displayed separately from the AI colbot system 100, they may correspond to a configuration included in the AI colbot system 100, and the STT/TTS/Hybrid engine Hybrid engine can be included in a kind of AI engine. In addition, although not specifically disclosed in FIG. 6 , the AI engine may form a structure included in the recognition module 110 .

In addition, the AI callbot system 100 can utilize the delivery address recognition method described above in the order address recognition process, and can clearly support order menu recognition and order address recognition through the backup counselor service/solution 300 , One information and the like may be delivered to the cloud ordering system 400 .

In the cloud ordering system 400, order-related information (menu, address, etc.) is transferred to the POS store POS linkage-Agent 500 through the franchise server, and delivered to the delivery agency service linkage 600 to automatically order for call orders. service can be provided.

7 is a view showing the progress of the AI ordering service according to an embodiment of the present invention.

As can be seen in FIG. 7 , in the present invention, various results are derived according to the customer's intention (packaging, delivery, order cancellation, etc.). In addition, the process of requesting a menu question from the customer and recognizing the customer's vocalization by the recognition module 110 is divided into a plurality of cases and displayed.

For example, it is possible to classify a plurality of intentions such as menu recognition, similar menu name recognition, order cancellation, agent connection, menu not recognition, price inquiry, etc. can be checked through

It goes without saying that one or more of the various embodiments of the present invention may be combined with each other to constitute a new embodiment.

A method of identifying a delivery address through voice recognition according to various embodiments of the present invention includes a recognition module in the AI callbot system, and in a state in which the recognition module for recognizing the delivery address is learned, (a) the call center infrastructure system , receiving the order call from the consumer's terminal, (b) the AI callbot system receives the order call from the call center infrastructure system, and checks the delivery address included in the order call using the recognition module, (c) ) The AI callbot system registers the order form including the delivery address in the cloud order system, (d) the in-store POS terminal receives the order form from the cloud order system, and displays the information included in the order form on the screen for a preset time. displaying the display so that the person in charge in the store can confirm the order, and (e) if there is no order confirmation for the preset time, the order call is automatically canceled. It may include printing the order form through the device, and transmitting information included in the order form to the delivery agency device.

According to another feature of the present invention, in step (b), the recognition module of the AI callbot system identifies the delivery address from the voice data of the consumer of the order call, separating the delivery address into a basic address and a detailed address, the basic Comparing the address with the canonical address list of the Address API, identifying the canonical address corresponding to the base address from the canonical address list, replacing the base address with the canonical address, and combining the canonical address and the detailed address to obtain a delivery address It may further include a step of completing.

According to another feature of the present invention, after the step of separating the basic address and the detailed address, before the step of comparing the basic address with the standard address list of the address API, the Korean recognition part for English included in the basic address, the space error part , and identifying at least one of the Korean recognition part of the special symbol, and substituting the Korean recognition part for English into English, correcting the space error part, or substituting the Korean recognition part of the special symbol with a special symbol. may include more.

According to another feature of the present invention, the step of comparing the base address with the standard address list of the address API includes clustering the standard address list into addresses within a preset distance range centered on the address of the store, and clustering the base address. It may further include the step of comparing with the standard address list.

According to another feature of the present invention, in the step of comparing the basic address with the standard address list of the address API, the region adjacent to the store is set in gu or dong, which is a preset address unit based on the address of the store, based on the standard address list. clustering into addresses within a region; and comparing the base address to the clustered standard address list.

According to another feature of the present invention, the step of comparing the base address with the standard address list of the address API comprises: identifying a standard word included in the standard address list;

forming a list of synonyms of standard words; comparing words that do not match a standard word of a standard address list among base addresses with a list of synonyms; If identified, it may further include the step of replacing a word that does not match the standard word with the standard word.

A system for identifying a delivery address through voice recognition according to various embodiments of the present invention includes a recognition module in the AI callbot system, and in a state in which the recognition module for recognizing a delivery address is learned, an order call from a consumer's terminal AI callbot system that receives an order call from the call center infrastructure system that receives , and the order form from the cloud order system, and the information contained in the order form is displayed on the screen for a preset time so that the in-store manager can confirm the order. and may include an in-store POS terminal that prints the order form through an in-store printing device and transmits information included in the order to the delivery agency device when the order is confirmed for a preset time.

The embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software field. Examples of the computer-readable recording medium include a hardware device specially configured to store and execute program instructions, such as a magnetic medium such as a hard disk. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform processing according to the present invention, and vice versa.

In the above, the present invention has been described with specific matters such as specific components and limited embodiments and drawings, but these are provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , those of ordinary skill in the art to which the present invention pertains can devise various modifications and variations from these descriptions.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments, and not only the claims described below, but also all modifications equivalently or equivalently to the claims described below belong to the scope of the spirit of the present invention. will do it

100: AI callbot system
110: recognition module
200: call center infrastructure system
300: backup consulting server
400: cloud ordering system
500: POS terminal
600: delivery agency device

Claims (7)

In the state that the recognition module is included in the AI callbot system, and the recognition module for recognizing the delivery address is learned,
(a) receiving, by the call center infrastructure system, an order call from a consumer's terminal;
(b) the AI callbot system, receiving the order call from the call center infrastructure system, and checking the delivery address included in the order call using the recognition module;
(c) registering, by the AI callbot system, an order book including the delivery address in the cloud order system;
(d) the in-store POS terminal receives the order form from the cloud order system, and displays the information included in the order form on the screen for a preset time so that the in-store person in charge confirms the order; and
(e) if there is no order confirmation for the preset time, the order call is automatically canceled, and when the order is confirmed for the preset time, the POS terminal prints the order through an in-store printer A method of identifying a delivery address through voice recognition, comprising the step of passing information included in the order form to a delivery agency device. According to claim 1,
Step (b) is,
identifying, by the recognition module of the AI callbot system, a delivery address from the voice data of the consumer of the order call;
separating the delivery address into a basic address and a detailed address;
comparing the base address with a standard address list of an address API;
identifying a standard address corresponding to the base address from the standard address list, and replacing the base address with a standard address; and
Further comprising the step of combining the standard address and the detailed address to complete the delivery address, the method of identifying a delivery address through voice recognition. 3. The method of claim 2,
After the step of separating the base address and the detailed address, before the step of comparing the base address with the standard address list of the address API,
identifying at least one of a Korean recognition part for English included in the basic address, a space error part, and a Korean language recognition part of a special symbol; and
To identify a delivery address through voice recognition, further comprising the step of replacing the Korean recognition part for the English language with English, correcting the space error part, or replacing the Korean recognition part of the special symbol with the special symbol Way. 3. The method of claim 2,
Comparing the base address with the standard address list of the address API comprises:
clustering the standard address list into addresses within a preset distance range based on the address of the store; and
and comparing the base address to the clustered canonical address list. 3. The method of claim 2,
Comparing the base address with the standard address list of the address API comprises:
clustering the standard address list into addresses within the area by setting an area adjacent to the store in a gu or dong unit that is a preset address unit based on the address of the store; and
and comparing the base address to the clustered canonical address list. 3. The method of claim 2,
Comparing the base address with the standard address list of the address API comprises:
identifying a standard word included in the standard address list;
forming a list of similar words of the standard word;
comparing a word in the base address that does not match the standard word in the standard address list with the similar word list; and
When a word that does not match the standard word among the basic address is identified in the list of similar words, further comprising the step of replacing a word that does not match the standard word with the standard word, the delivery address through voice recognition How to identify. In the state that the recognition module is included in the AI callbot system, and the recognition module for recognizing the delivery address is learned,
a call center infrastructure system that receives an order call from a consumer's terminal;
The AI callbot system that receives the order call from the call center infrastructure system, uses the recognition module to check the delivery address included in the order call, and registers an order book including the delivery address in the cloud order system; and
Upon receiving the order form from the cloud order system, the information included in the order form is displayed on the screen for a preset time so that the person in charge in the store confirms the order, and if there is no order confirmation for the preset time, the order Including an in-store POS terminal that automatically cancels the call, and prints the order form through an in-store printing device when the order is confirmed for the preset time, and delivers the information included in the order to the delivery agency device, A system that identifies delivery addresses through speech recognition.

Images