WO2023075254A1

WO2023075254A1 - Pick-up guide method and system using object recognition artificial intelligence

Info

Publication number: WO2023075254A1
Application number: PCT/KR2022/015751
Authority: WO
Inventors: 정동관; 현준; 김영길
Original assignee: 주식회사 사운드그래프
Priority date: 2021-10-29
Filing date: 2022-10-17
Publication date: 2023-05-04
Also published as: KR20230061901A

Abstract

In the present invention, disclosed is a pick-up guide system comprising: an order information management part which assigns an order number to an ordered product and stores order information corresponding to the order number; a product recognition part that recognizes a product placed on a pick-up table by using an image captured through a camera; an order matching part that matches the product with the order number by using the order information; and a display device on which the order number is displayed to correspond to the product. According to the present invention, completion of cooking may be notified to a customer through an indication corresponding to a prepared beverage, and whether the customer has picked up is automatically recognized so that order processing completion may be automatically checked.

Description

Pick-up guidance method and system using object recognition artificial intelligence

The present invention relates to a pickup guidance method and system using object recognition artificial intelligence, and more particularly, to a method and system for guiding pickup so that a product ordered by a customer is delivered to a customer at a store in a non-face-to-face format according to order information. it's about

Among retail stores, the area that has grown the most over the past decade is QSR (Quick Service Restaurant) type stores. A variety of food and beverages are ordered at the QSR store, payment is made, and the customer receives the cooked food and beverages to eat in the store or take the food and beverages out of the store.

In recent years, customers have moved away from the existing POS (Point Of Sale) method at QSR stores and have been able to place orders using in-store kiosks or place orders outside the store through apps installed on mobile terminals.

When using a kiosk or mobile app, as the pickup process through the issuance of a vibration bell that informs the completion of cooking of food and beverages is impossible, as in the case of ordering through the existing POS, a method of notifying the completion of cooking of food and beverages using a display in the form of an electric signboard is used. .

In a pick-up process using a display, which is currently widely practiced, when a customer does not wait in a pick-up zone to receive a drink, there is an inconvenience in that the customer has to check the finished drink one by one to find the drink he or she ordered. In addition, since confirmation is required between customers for a plurality of ordered beverages, there is a risk of confusion caused by an inconvenient situation or misidentification.

As a technology related to the present invention, Republic of Korea Patent Registration No. 10-2315615, a food and beverage transport and collection system in a store using image recognition and a food and beverage transport and collection method using the same disclose an image acquisition unit including a plurality of cameras, The purpose of image acquisition is to analyze the customer's face image and identify the customer, which is different from the image analysis of the present invention for the purpose of recognizing the beverage that has been cooked.

As a technology related to the present invention, Korean Patent Registration No. 10-2187090, an unmanned beverage manufacturing system, discloses a photographing means and a camera. However, the photographing means is a means for photographing the customer, and the camera is for photographing the manufacturing process of the beverage and recognizing a malfunction of the beverage manufacturing machine through the photographed image, the present invention for the purpose of recognizing the beverage that has been cooked. It is distinct from image analysis of

As a technology related to the present invention, Korean Patent Registration No. 10-1667025, an electronic table device for a smart order management system, discloses a heating unit for heating ordered food, and a function of cooking ordered food using an electronic table. Corresponding to the device of, there is a difference in the purpose, configuration and effect of the present invention compared to the present invention, which guides the process of picking up the cooked beverage to the customer.

One problem to be solved by the present invention is to provide a method and system for guiding a ready-to-cook beverage to be accurately picked up by a customer without error.

One problem to be solved by the present invention is to inform the completion of cooking through a display corresponding to the beverage prepared for the customer, and the staff automatically recognizes whether the customer has picked up the product, thereby automatically performing the entire pickup check process. and to provide a system.

One problem to be solved by the present invention is to provide a pickup guidance method and system capable of preventing errors that may occur in the process of picking up an order product through matching the order number and the product to be picked up.

A pick-up guidance system according to an embodiment of the present invention includes an order information management unit that assigns an order number to an ordered product and stores order information corresponding to the order number; A product recognition unit for recognizing a product placed on the pick-up table using an image captured by a camera; an order matching unit that matches the product to the order number using order information; and a display device displaying an order number corresponding to the product.

In addition, the order information management unit may be configured to store order information including information about order time, type, and quantity of ordered products for each order number.

In addition, the product recognition unit may be configured to recognize the quantity of products, the type of products, the type of container containing the product, and the presence or absence of a tray on which the container is placed based on object recognition through image analysis.

In addition, the order matching unit may be configured to match a product to an order number using product information determined based on the order information and object recognition.

In addition, the order matching unit may be configured to match the product to the order number in consideration of the minimum cooking time required for cooking the ordered product and the delay rate of the previous product based on the order time.

In addition, the display device may be configured to display the order number on at least one of a body of the product, a table on which the product is placed, and a background of a location where the product is placed.

In addition, the display device may display the order number on the table on which the product is placed in a projection method, and project light recognizing the order number displayed on the customer's order table.

A pick-up guidance method according to an embodiment of the present invention includes assigning an order number to an ordered product and storing order information corresponding to the order number; Recognizing a product placed on a pick-up table using an image captured by a camera; matching the product to the order number using order information; and displaying an order number corresponding to the product.

In addition, recognizing the product may include recognizing the presence or absence of a tray on which a container containing the product is placed; and recognizing the type and quantity of products.

In addition, the pickup guidance method includes recognizing a product that has been picked up by a customer and disappeared from the pickup table; and completing order processing by updating order information corresponding to the product.

In addition, the pick-up guide method may further include storing information and image information about a time when a product on the pick-up table is picked up by a customer.

Also, the displaying of the order number corresponding to the product may include displaying the order number on at least one of a body of the product, a table on which the product is placed, and a background of a position where the product is placed.

In addition, the step of displaying the order number corresponding to the product may include recognizing the boundary of the product; and displaying the order number on a table on which the product is placed in a projection manner so as to come into contact with a boundary of the product.

Details of other embodiments are included in the "specific details for carrying out the invention" and the accompanying "drawings".

Advantages and/or features of the present invention, and methods of achieving them, will become apparent with reference to the various embodiments described below in detail in conjunction with the accompanying drawings.

However, the present invention is not limited only to the configuration of each embodiment disclosed below, but may also be implemented in various other forms, and each embodiment disclosed herein only makes the disclosure of the present invention complete, and the present invention It is provided to completely inform those skilled in the art of the scope of the present invention, and it should be noted that the present invention is only defined by the scope of each claim of the claims.

According to the present invention, ready-to-cook beverages and the like can be accurately picked up by customers without errors.

In addition, completion of cooking may be notified to the customer through a display corresponding to the prepared beverage, and completion of order processing may be automatically checked by automatically recognizing whether the customer has picked up or not.

In addition, errors that may occur in the process of picking up an order item can be prevented by matching the order number with the product to be picked up.

1 is a network relationship diagram of a pick-up guidance system according to an embodiment of the present invention.

2 is a block diagram of a pickup guidance system according to an embodiment of the present invention.

3 is a flowchart of a pick-up guidance method according to an embodiment of the present invention.

4 is a data flow diagram of a pick-up guidance method according to an embodiment of the present invention.

5 is an exemplary view for explaining a pick-up table according to an embodiment of the present invention.

6 is an exemplary diagram for explaining a camera and a display device according to an embodiment of the present invention.

Before explaining the present invention in detail, the terms or words used in this specification should not be construed unconditionally in a conventional or dictionary sense, and in order for the inventor of the present invention to explain his/her invention in the best way It should be noted that concepts of various terms may be appropriately defined and used, and furthermore, these terms or words should be interpreted as meanings and concepts corresponding to the technical idea of the present invention.

That is, the terms used in this specification are only used to describe preferred embodiments of the present invention, and are not intended to specifically limit the contents of the present invention, and these terms represent various possibilities of the present invention. It should be noted that it is a defined term.

In addition, it should be noted that in this specification, singular expressions may include plural expressions unless the context clearly indicates otherwise, and similarly, even if they are expressed in plural numbers, they may include singular meanings. .

Throughout this specification, when a component is described as "including" another component, it does not exclude any other component, but further includes any other component, unless otherwise stated. It can mean you can do it.

Furthermore, when a component is described as “existing inside or connected to and installed” of another component, this component may be directly connected to or installed in contact with the other component, and a certain It may be installed at a distance, and when it is installed at a certain distance, a third component or means for fixing or connecting the corresponding component to another component may exist, and now It should be noted that the description of the components or means of 3 may be omitted.

On the other hand, when it is described that a certain element is "directly connected" to another element, or is "directly connected", it should be understood that no third element or means exists.

Similarly, other expressions describing the relationship between components, such as "between" and "directly between", or "adjacent to" and "directly adjacent to" have the same meaning. should be interpreted as

In addition, in this specification, the terms "one side", "the other side", "one side", "the other side", "first", "second", etc., if used, refer to one component It is used to be clearly distinguished from other components, and it should be noted that the meaning of the corresponding component is not limitedly used by such a term.

In addition, in this specification, terms related to positions such as "top", "bottom", "left", and "right", if used, should be understood as indicating a relative position in the drawing with respect to the corresponding component, Unless an absolute position is specified for these positions, these positional terms should not be understood as referring to an absolute position.

In addition, in this specification, in specifying the reference numerals for each component of each drawing, for the same component, even if the component is displayed in different drawings, it has the same reference numeral, that is, the same reference throughout the specification. Symbols indicate identical components.

In the drawings accompanying this specification, the size, position, coupling relationship, etc. of each component constituting the present invention is partially exaggerated, reduced, or omitted in order to sufficiently clearly convey the spirit of the present invention or for convenience of explanation. may be described, and therefore the proportions or scale may not be exact.

In addition, in the following description of the present invention, a detailed description of a configuration that is determined to unnecessarily obscure the subject matter of the present invention, for example, a known technology including the prior art, may be omitted.

Hereinafter, embodiments of the present invention will be described in detail with reference to related drawings.

1 is a network relationship diagram of a pick-up guidance system according to an embodiment of the present invention. Referring to FIG. 1 , components and a network 500 constituting a pick-up guidance system 10 according to an embodiment of the present invention are depicted. The pickup guidance system 10 may be configured to include a pickup guidance device 100 , a control server 200 and an artificial intelligence server 200 .

The pick-up guidance device 100 performs a function of managing customer pick-up of goods manufactured in the store. The pick-up guidance device 100 may be implemented in the form of a Point Of Sale (POS) terminal. The pick-up guidance device 100 may be configured to include a main terminal 110, an auxiliary terminal 120, a camera 130, and a display device 140.

The control server 200 performs a function of integrally managing the pickup guidance devices 100 installed in a plurality of stores. The control server 200 may collect data from the plurality of pick-up guidance devices 100 and transmit updated data necessary for the device to the plurality of pick-up guidance devices 100 .

The artificial intelligence server 200 may provide a service for performing an artificial intelligence function of the pick-up guidance device 100, in particular, the main terminal 110. For example, the artificial intelligence server 200 may perform functions of learning an artificial intelligence model, collecting data necessary for learning, generating a training data set, and providing an artificial intelligence platform and artificial intelligence API. there is.

Network 500 includes wired and wireless networks, such as serial communications, local area networks (LANs), wide area networks (WANs), the Internet, intranets and extranets, and mobile networks, It may be any suitable communication network including, for example, cellular, 3G, LTE, WiFi networks, ad hoc networks, and combinations thereof.

Network 500 may include connections of network elements such as hubs, bridges, routers, switches, and gateways. Network 500 may include one or more connected networks, e.g., a multiple network environment, including a public network such as the Internet and a private network such as a secure corporate private network. Access to network 500 may be provided through one or more wired or wireless access networks.

2 is a block diagram of a pick-up guidance device according to an embodiment of the present invention.

Referring to FIG. 2 , the pick-up guidance device 100 may include a main terminal 110, an auxiliary terminal 120, a camera 130, and a display device 140.

The main terminal 110 has a basic function of receiving order information from a customer and storing the received order information, and controls and communicates with the auxiliary terminal 120, the camera 130, and the display device 140. perform a function

The main terminal 110, through the control of the camera 130, when a customer takes a product, for example, food or beverage placed on the pickup table 150 and the food or beverage disappears from the pickup table 150, the previous image and the current image Food and beverages that have disappeared from the pickup table 150 are determined by comparing spirituality with each other, order information corresponding to the order number is updated in the form of customer pickup, and order information displayed on the auxiliary terminal 120 installed in the kitchen is also updated. can

The main terminal 110 detects an area on the pick-up table that is empty through the control of the camera 130 and the display device 140, projects marketing content consisting of images and videos for product promotion and promotional advertisements onto the area, and adds it. It can function to convey relevant information.

The auxiliary terminal 120 may be installed in a kitchen where products ordered by customers are manufactured, for example, beverages ordered by customers are cooked. The auxiliary terminal 120 may receive a signal of product manufacturing completion from the manufacturing staff through an input function, and display order information to the manufacturing staff through an output function.

The camera 130 performs a function of collecting image data necessary for product recognition when a manufactured product is placed on the pick-up table 150 . The collected image data is transmitted to the main terminal 110 .

The display device 140 performs a function of displaying an order number matched to a recognized product on the pickup table 150 . Recognition of the product and matching between the product and the order number are performed by the main terminal 110, and the display device 140 transfers the order number matched to the product under the control of the main terminal 110 to the pickup table where the product is arranged ( 150) can be displayed.

The display device 140 may be implemented in the form of an LED or LCD type device or a projector. Depending on the type of display, an LED or LCD at a location where products are arranged may display an order number, or a light displaying an order number of a product may be projected onto a floor or wall where a boundary of the product is formed.

The display device 140 may detect movement of products arranged on the pick-up table 150 through the object recognition and tracking function of the main terminal 110 and follow order information to be displayed.

Referring back to FIG. 2 , the main terminal 110 includes a processor 111, an order information management unit 112, a product recognition unit 113, a recognition model 114, an order matching unit 115, and an environment setting unit 116 ), a storage device 117 and a communication device 118.

The processor 111 performs a function of integrating and controlling components of the main terminal 110 through calculation, storage, and communication functions. For example, the processor 111 includes an order information management unit 112, a product recognition unit 113, a recognition model 114, an order matching unit 115, an environment setting unit 116, and a storage device according to a previously prepared algorithm. 117 and the communication device 118 can be given an operation command.

The order information management unit 112 performs functions of generating and storing order information from generating an order number according to a customer's product order request. That is, the order information management unit 112 has a function of processing information and data required for order processing until the product is picked up by the customer.

The product recognition unit 113, when the product is manufactured by the manufacturing staff and placed on the pick-up table, the appearance of the product, the placement position of the product, and the item of the product based on the image data in which the product is photographed. performs a recognition function. The product recognition unit 113 may include a recognition model 114 . The recognition model 114 is an artificial neural network for product recognition, for example, a model in which an object recognition neural network such as a synthetic neural network (CNN) is implemented.

The recognition model 114 performs a function of recognizing a product using an artificial intelligence algorithm. The recognition model 114 may be updated through learning, and learning and training may be performed in the cloud by the artificial intelligence server 200 . Image data photographed by the camera 130 may be used to construct a training data set necessary for learning and training.

The order matching unit 115 matches the order number with the product arranged on the pick-up table based on the recognition result by the product recognition unit 113 and the signal received from the auxiliary terminal 120, and the order number and the order number. It has a function to output the position value to be displayed.

The order matching unit 115 may be configured to match a product to an order number in consideration of a minimum cooking time required for cooking an ordered product based on an order time and a delay rate of a previous product. When the main terminal 110 does not use the signal transmission of product cooking completion performed by the auxiliary terminal 120, the order matching unit 115 must match the recognized product to the order number based on object recognition. . The order matching unit 115 determines an order that violates the sequential pick-up table arrangement according to the order number, in consideration of the minimum cooking time required to complete cooking of the product and the delay rate of the previous product, when the products are lacking in distinguishing features. and match the order number to the product. The delay rate means the ratio of the time taken for a corresponding order to the time taken from placing an order to arranging a pick-up table in the absence of a previous order.

The environment setting unit 116 has a function of correcting environments such as the size of the pickup table 150 installed in different stores equipped with the pickup guide device 100, the illumination of the store, and the shooting angle of the camera 130. .

The environment setting unit 116 determines the area of the pickup table 150 using a marker indicating the recognition area of the pickup table 150, and the coordinate system of the image data received from the camera 130 and the display device 140 , For example, it has a function of correcting the coordinate system of the projection surface projected using a projector.

The environment setting unit 116 has a function of checking whether or not it is affected by the illumination intensity or the shooting angle within the recognition area of the pick-up table 150 through a test.

The marker is an object having a specific color and is placed at the vertex of the recognition area of the pickup table 150 during initial environment setting, and the coordinates of the camera 130 are confirmed through the image input through the camera 130, and the display device ( 140), after displaying four coordinate values on the pick-up table 150 using a projector, the coordinate values are moved to fit the position of the marker, and are used to match the recognition area of the actual pick-up table 150 and the projection area. .

The storage device 117 performs a function of storing an order number, order information corresponding to the order number, and image data collected through the camera 130 . In addition, the storage device 117 may be configured to store various data processed in the pick-up guidance process.

The communication device 118 includes a control server 200 connected through the network 500, a communication module necessary for communication with the artificial intelligence server 300, and an auxiliary terminal 120, a camera 130, and a display device 140 ) and may be configured to include a communication module including various protocols capable of communicating with.

Referring to FIG. 3, the pick-up guidance method (S100) assigns an order number to an ordered product and stores order information corresponding to the order number (S110), a product placed on a pick-up table using an image. Recognizing (S120), matching the product to the order number using order information (S130), displaying the order number corresponding to the product (S140), recognizing product pickup by the customer (S150) ), and updating order information and completing order processing (S160).

The pick-up guidance device 100 may assign an order number to the ordered product and store order information corresponding to the order number (S110). The ordered products may include food and beverages that can be cooked immediately, for example, coffee, juice, and cakes cooked in stores such as cafes. A customer may order a product through various methods, for example, purchase of gift corn, the Internet, a kiosk, or a POS terminal. The order information corresponding to the order number may include information about the item and quantity of the ordered product, and whether or not it is packed for takeout.

The pick-up guidance device 100 may recognize a product placed on the pick-up table using an image captured through a camera (S120). The pick-up guidance device 100 may recognize the presence or absence of a tray on which a container containing a product is placed, and recognize the type and quantity of the product. Characteristics of different products ordered, for example, product type, quantity, presence or absence of a tray, type of container, etc., may act as key points for product recognition and order number matching.

The pick-up guidance device 100 may match the product to the order number using the order information (S130). Information collected through the recognition of the product itself may be the basis for matching the order number to the recognized product. However, an error may occur in recognizing the object of a product unless all of the products have different appearances. In order to prevent such an error, the pick-up guidance device 100 can predict the order number of the product to be placed on the pick-up table in advance by allowing the main terminal 110 to receive a product completion signal from the auxiliary terminal 120. The main terminal 110 of the pick-up guidance device 100 may recognize a position where the product of the predicted order number is placed, output a position value corresponding to the position, and transmit it to the display device 140 .

The pick-up guidance device 100 may display the order number corresponding to the product (S140). The pick-up guidance device 100 may display the order number corresponding to the product. For the corresponding display, the pickup guidance device 100 recognizes the boundary of the product using an object recognition algorithm, and the order number or nickname of the orderer of the product for the floor or wall of the pickup table on which the boundary is formed through the projector can project.

In addition, the light projected from the projector, which is the display device 140, includes infrared rays capable of recognizing the barcode of the product displayed on the order receipt, so that the receipt possessed by the customer is read to determine whether the order number of the product matches or does not match. The pickup guide device 100 may be configured to output sounds of different tones according to

The pick-up guidance device 100 may be configured to display the order number on at least one of the body of the product, the table on which the product is placed, and the background of the location where the product is placed, for example, a vertical or inclined surface. Since the configuration of the pick-up table and the structure of the store may be designed differently depending on store conditions, the order number may be displayed in various forms.

The pick-up guide device 100 may be configured to recognize the boundary of the product and display the order number on the table where the product is placed in a projection manner so as to come into contact with the boundary of the product. Since products corresponding to different order numbers are arranged on the pick-up table, it is necessary to distinguish between products by spacing, and therefore, the pick-up guide device 100 recognizes the boundary of the product and displays the corresponding order number close to the boundary. can be displayed

The pickup guidance device 100 may complete order processing by recognizing a product that has been picked up by a customer and disappeared from the pickup table (S150) and updating order information corresponding to the product (S160). Order processing may be completed through the customer's product pickup. The pick-up guidance device 100 can check the customer pick-up process, which was impossible to check in the prior art, using object recognition.

The pick-up guidance device 100 may store information and image information about a time when a product on a pick-up table is picked up by a customer. In order to detect and solve errors during the customer pickup process, information on the time the customer is picked up and a pickup image of the corresponding situation may be stored in the storage device 117 .

Referring to FIG. 4 , the pick-up guidance device 100 configured to include a main terminal 110, an auxiliary terminal 120, a camera 130, and a display device 140 performs a pick-up guidance method. Data flow is depicted. A process of storing and transmitting order information (S110) to updating order information (S230) will be described according to data flow.

It is described that the main terminal 110 independently performs the process of the S100 series, the auxiliary terminal 120 the process of the S200 series, and the camera 130 independently performs the process of the S300 series. The process performed by is described as a passive process and the main terminal 110 is the subject.

A customer may request a product order from the pick-up guidance device 100, that is, the main terminal 110, through a step using a variety of methods, for example, a kiosk, a personal mobile terminal, or a verbal method. An order number is generated according to the order request, and the main terminal 110 may store order information and transmit the order information to the auxiliary terminal 120 (S110). The main terminal 110 shares order information with the auxiliary terminal 120 .

The auxiliary terminal 120 receives order information from the main terminal 110 (S210). The cooking of the product is completed by the step ( S ₁ ), and the cooking completion signal is transmitted to the main terminal 120 through the auxiliary terminal 120 . The cooked product is put into the pick-up table 150 by a step (S ₂ ).

The camera 130 photographs the product placed on the pick-up table, and collects product images on which the product is displayed (S310). The camera 130 transmits product images to the main terminal 110 . The main terminal 110 receives a product image from the camera 130 (S114) and recognizes the product using an object recognition algorithm (S120). The range or type of product recognition may include recognition of the boundary of a product to recognition of an item and quantity of a product, according to an embodiment.

Next, the main terminal 110 matches the product with the order number using information obtained through product recognition (S130). The order number for the product currently placed on the pick-up table and the position value of the product are determined and transmitted to the display device 140 . The display device 140 receives the order number and the position value of the product, and displays the order number at the corresponding position (S140). The corresponding position refers to a position close to the body of the product or the boundary of the product.

The customer picks up the product placed on the pick-up table (g), and the camera 130 collects pickup images of the pick-up scene (S330). The camera 130 transmits the pickup image to the main terminal 110 (S340).

The main terminal 110 receives the pickup image from the camera 130 (S142). The main terminal 110 confirms customer pickup using the pickup image (S150). The main terminal 110 updates the order information (S160), and according to synchronization, the order information stored in the secondary terminal 120 is also updated (S230). This may complete the order and order processing.

5 is an exemplary view for explaining a pick-up table according to an embodiment of the present invention. Referring to FIG. 5 , products arranged on the pick-up table 150 are depicted. The #1 boundary, #2 boundary, and #3 boundary for each product serve as standards for displaying the order number or nickname of the orderer. That is, the order number or nickname may be displayed adjacent to the border. A marker may be used to determine the position of the product on the pick-up table.

Referring to FIG. 6 , as an example of the pick-up guide device 100, a camera 130 installed on the ceiling of a place where a pick-up table 150 is prepared and a projector serving as a display device 140 are depicted. The projector and camera 130 may be configured to perform a PTZ function using a driving motor. The pick-up guidance device 100 recognizes that product #A-01 composed of two drinks has a single order number, and consists of two drinks and one cake on a tray through recognition of the existence of the product and the boundary of the product. #A-02 can be recognized as having a single order number. Through synchronization, the auxiliary terminal 120 may be configured to share order information of the main terminal 110 , cooking completion, and customer pickup information.

In this way, according to one embodiment of the present invention, a ready-to-cook beverage or the like can be accurately picked up by a customer without error.

In the above, various preferred embodiments of the present invention have been described with some examples, but the description of various embodiments described in the "Specific Contents for Carrying Out the Invention" section is only exemplary, and the present invention Those skilled in the art will understand from the above description that the present invention can be practiced with various modifications or equivalent implementations of the present invention can be performed.

In addition, since the present invention can be implemented in various other forms, the present invention is not limited by the above description, and the above description is intended to complete the disclosure of the present invention and is common in the technical field to which the present invention belongs. It is only provided to completely inform those skilled in the art of the scope of the present invention, and it should be noted that the present invention is only defined by each claim of the claims.

The present invention can be used in the field of service technology that delivers products non-face-to-face.

Claims

an order information management unit that assigns an order number to an ordered product and stores order information corresponding to the order number;

A product recognition unit for recognizing a product placed on the pick-up table using an image captured by a camera;

an order matching unit that matches the product to the order number using the order information; and

It is configured to include a display device for displaying the order number corresponding to the product,

Pickup Guidance System.
The method according to claim 1, wherein the order information management unit,

A pick-up guidance system configured to store order information including information about order time, type of product ordered, and quantity for an order number.
The method according to claim 1, wherein the product recognition unit,

Based on object recognition through image analysis, it is configured to recognize the quantity of the product, the type of product, the type of container containing the product, and the presence or absence of a tray on which the container is placed,

Pick-up Guidance System.
The method according to claim 1, wherein the order matching unit,

A pickup guidance system configured to match a product to an order number using product information determined based on the order information and object recognition.
The method according to claim 1, wherein the order matching unit,

Configured to match the product to the order number considering the minimum cooking time required for cooking the ordered product based on the order time and the delay rate of the previous product,

Pickup Guidance System.
The method according to claim 1, wherein the display device,

The pick-up guidance system configured to display the order number on at least one of a body of the product, a table on which the product is placed, and a background of a location where the product is placed.
The method according to claim 1, wherein the display device,

Display the order number on the table where the product is placed in a projection method,

project together a light recognizing the order number indicated on the customer's order table;

Pickup Guidance System.
assigning an order number to an ordered product and storing order information corresponding to the order number;

Recognizing a product placed on a pick-up table using an image captured by a camera;

matching the product to the order number using the order information; and

, Pick-up guidance method configured to include the step of displaying the order number corresponding to the product.
The method according to claim 8, wherein the step of recognizing the product,

Recognizing the presence or absence of a tray on which a container containing a product is placed; and

Consisting of recognizing the type and quantity of the product,

Pick-up instructions.
The method of claim 8,

Recognizing the product that has been picked up by the customer and disappeared from the pickup table; and

, Pickup guidance method configured to further include the step of completing order processing by updating order information corresponding to the product.
The method of claim 8,

A pickup guidance method configured to further include storing information and image information about a time when a product on a pickup table is picked up by a customer.
The method of claim 8,

The step of displaying the order number corresponding to the product,

Wherein the pick-up guidance method is configured to display the order number on at least one of a body of the product, a table on which the product is placed, and a background of a location where the product is placed.
The method of claim 8,

The step of displaying the order number corresponding to the product,

recognizing the boundary of the product; and

and displaying the order number on a table on which the product is placed in a projection manner in contact with a boundary of the product.