KR102543731B1 - Food Sales Machine with Artificial Intelligence and Digital Humans, and Driving Method Thereof - Google Patents

Abstract

The present invention relates to a food sales apparatus to which artificial intelligence and a digital human are applied and a method of driving the same, and a food sales apparatus to which artificial intelligence and a digital human are applied according to an embodiment of the present invention is to display a digital human of artificial intelligence on a screen. It controls the display unit displayed on the display unit and the digital human to recommend ingredients and recipes for manufacturing food ordered by users visiting the store to users, and displays the process of manufacturing food using the ingredients according to the recipe by the digital human. It may include a control unit implemented on a negative screen.

Description

Food Sales Machine with Artificial Intelligence and Digital Humans, and Driving Method Thereof

The present invention relates to a food sales device to which artificial intelligence and digital humans are applied and a method of operating the device, and more particularly, to optimally mix fresh food (materials for making) by sensing, or detecting, the freshness of ingredients based on an artificial neural network. It relates to a food sales device applying artificial intelligence and a digital human that produces and provides fresh food on the spot by applying a recipe, and a method of operating the device.

Vending machines are unmanned vending machines that use coins or cards. A vending machine is a vending machine for tickets, cigarettes, coffee, beverages, and other products, and is a machine in which a user's desired product comes out automatically when a coin is inserted or a card is inserted. The world's first vending machine can be said to be the beginning of the holy water vending machine that appeared in Egypt in 215 BC. The rapid increase in vending machines is because the emergence of a new distribution structure was required due to changes in the marketing environment such as mass production, mass consumption, and changes in consumption patterns following the transition from a labor-intensive industrial structure to a technology-intensive industrial society. . Therefore, in addition to the emergence of new distribution structures such as supermarkets and shopping centers, the emergence of unmanned vending machines was inevitable due to rising labor costs, limited locations, and convenience of purchase.

On the other hand, in recent years, economic growth has been a stimulus to the growth of the frozen processed food market, and consumers' perceptions of food culture and frozen food are gradually changing. Longer working hours, increased social advancement of women, and westernization of food and culture are increasing consumer demand for frozen foods in many urban centers. Freer economic policies, higher standards of living, and improved manufacturing and distribution networks have increased the purchasing power of urban consumers. The growth points of the frozen processed food market are convenience and health. Due to this lack of time, consumers prefer convenient packaged foods including frozen processed foods. Demand for convenience foods such as frozen instant foods is expected to surge due to the dynamic and diverse lifestyles of the young. As the busy lifestyle of consumers is expected to increase the demand for simple frozen instant food and processed food that is easy to cook, it is required to propose a new type of vending machine that is different from the existing vending machine.

In recent years, as consumers' needs for food have become more sophisticated and diversified, for example, even in the case of the same food, there is a demand for technology development such as vending machines that prepare food by cooking it on the spot and further maintaining freshness.

Korean Patent Registration No. 10-1078714 (2011.10.26) Korea Patent Registration No. 10-2085149 (2020.02.28)

An embodiment of the present invention applies artificial intelligence and digital human, which senses the freshness of ingredients based on an artificial neural network and applies the optimal fresh food (material for making) recipe to prepare and provide fresh food on the spot. Its purpose is to provide a food sales device and a driving method of the device.

A food sales device to which artificial intelligence and digital humans are applied according to an embodiment of the present invention includes a display unit displaying a digital human of artificial intelligence on a screen, and ingredients and recipes for manufacturing food ordered by users visiting a store. and a control unit which controls the digital human to recommend a recipe to the users, and implements a process in which the digital human prepares the food using the ingredients according to the recipe on the screen of the display unit.

The food selling device may further include an ingredient storage unit for freezing or refrigerating the ingredients at a designated temperature, and a freshness measuring unit for measuring the freshness of ingredients selected from the ingredient storage unit when preparing the food.

The freshness measuring unit may measure freshness by pixel analysis of a photographed image taken when the material is used, or measure freshness by fluorescence spectroscopy using fluorescence spectral lines detected by providing a light source to the material.

The control unit may change the race and clothes of the digital human based on the characteristics of the store where the food selling device is installed or the country, and implement the change on the screen.

The controller may recognize the language of the user ordering the food and the contents of the language, and respond in the same language as the recognized language.

In addition, a method of driving a food sales apparatus to which artificial intelligence and digital humans are applied according to an embodiment of the present invention includes displaying, by a display unit, a digital human of artificial intelligence on a screen; Controlling the digital human to recommend ingredients and recipes for preparing food to the users, and controlling the digital human to implement a process of manufacturing the food using the ingredients according to the recipe on the screen of the display unit Include steps.

The driving method may further include freezing or refrigerating the ingredients at a specified temperature by the ingredient storage unit, and measuring the freshness of the ingredients selected by the ingredient storage unit when the freshness measuring unit prepares the food. there is.

In the step of measuring the freshness, the freshness can be measured by pixel analysis of a photographed image taken when the material is used, or the freshness can be measured using a fluorescence spectroscopy method using a fluorescence spectral line detected by providing a light source to the material. .

In the controlling step, the race and clothing of the digital human may be changed and implemented on the screen based on the characteristics of the store where the food sales device is installed or the country.

The controlling may include recognizing the language of the user ordering the food and the contents of the language, and responding in the same language as the recognized language.

According to an embodiment of the present invention, when users visit, for example, an unmanned store, order food, and consume (or eat), they will be able to consume optimal fresh food that ensures the freshness of the ingredients.

In addition, according to an embodiment of the present invention, users with disabilities or different nationalities will be able to conveniently use the unmanned store through a conversation with an artificial intelligence digital human in the unmanned store.

1 is a diagram showing an unmanned food sales system according to an embodiment of the present invention;
2 is a view showing the food sales device of FIG. 1;
Figure 3 is a block diagram illustrating the detailed structure of the food sales device of Figure 1, and
FIG. 4 is a flowchart illustrating a driving process of the food vending device of FIG. 1 .

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a diagram showing an unmanned food sales system according to an embodiment of the present invention, and FIG. 2 is a diagram showing the food selling device of FIG. 1 .

As shown in FIGS. 1 and 2, the unmanned food sales system 90 to which artificial intelligence and digital humans are applied according to an embodiment of the present invention includes a food sales device 100, a communication network 110, and a food service device 120. ) and part or all of the third party device 130.

Here, “including part or all” means that some components such as the third party device 130 are omitted so that the unmanned food sales system 90 is configured, or some of the components constituting the food service device 120. Or, it means that all of them can be configured by being integrated into a network device (eg, a wireless switching device, etc.) constituting the communication network 110, and will be described as including all of them to help a sufficient understanding of the invention.

The food sales device 100 is installed in an arbitrary store and immediately prepares and provides food to users. The food sales device 100 according to an embodiment of the present invention senses the freshness of ingredients based on an artificial neural network, that is, artificial intelligence, and applies a combination of ingredients and a recipe for optimal fresh food to produce and provide fresh food on the spot. can do. For example, as shown in FIG. 2, the food sales device 100 includes a storage unit capable of refrigerating or freezing fresh ingredients at an optimal temperature, and a freshness measuring unit capable of checking the freshness of the ingredients. (or a sensing unit), an artificial intelligence control unit (or control unit) that determines the composition of ingredients, and a display unit that allows a digital human to recommend materials and recipes and to show the manufacturing process. Regarding the mixing of materials, the mixing of materials may be performed using the set data after presetting material mixing data related thereto in advance.

More specifically, the food sales device 100 may include a material storage unit for storing materials inside the main body 200 or on the rear side of the display device 210 as seen in FIG. A cooking robot or the like that cooks ordered food may be provided. Since various methods of cooking food are possible, such as cooking using a conveyor belt as well as a method using a cooking robot, the embodiment of the present invention will not be particularly limited to any one method. However, when the material is shipped or discharged through the material storage unit, the corresponding material can be operated in conjunction with the freshness measurement unit for freshness measurement. Of course, food production may simply be ramen production, but various foods that can be manufactured through prepared ingredients may be possible. Representatively, it may be a food such as a hamburger or the like. Above all, in the embodiment of the present invention, when at least one food is prepared and provided to users, the freshness of the ingredients is measured and the ingredients having the optimal freshness are used. Accordingly, the food selling apparatus 100 may perform an operation such as discarding the material and discharging the material again when the freshness of a specific ingredient falls below a standard as a result of freshness measurement. More details will be discussed later.

In addition, the food sales device 100 according to an embodiment of the present invention may operate based on an artificial intelligence digital human when manufacturing food ordered by users. For example, as seen in FIG. 2 , a display device 210 is provided on one side, for example, an upper portion of the main body 200, and a digital human is displayed on the screen through the corresponding display device 210. In addition, a food outlet 220 for discharging ordered food may be provided at the bottom of the display device 210, and a payment unit 230 for proceeding payment for ordered food may be provided at one side of the food outlet 220. In the case of the food outlet 220, it is possible to provide food that has been manufactured in various forms like an existing vending machine. For example, when food placed on a table is discharged to the outside by a user, it is sensed and the food outlet 220 is sensed. The operation of opening and closing the door of 220 can be controlled. Of course, the sensor may sense and control the user's hand or movement through an infrared sensor or the like. The payment unit 230 may allow a credit card to be inserted or various types of payment such as NFC (Near Field Communication) to be made. For example, when users ordering food use a terminal device such as a smartphone that they possess, NFC payment, simple payment, or app payment using the terminal device may be possible.

A food sales device 100 as shown in FIG. 2 may be provided on one side of the store, for example, on the kitchen side, and a table or the like where users can consume food may be provided around it. Also, a camera may be installed on one side of the store or in the food sales device 100 . Accordingly, when users visit a store, the artificial intelligence digital human implemented in the display device 210 of the food sales device 100 recognizes the customer's position through a camera or a sensor installed at the store's door, and recognizes the customer's position. Through this, digital humans can welcome customers' visits. For example, you can send a simple greeting. Also, when customers stand in front of the food selling device 100 and try to order food, the digital human may perform an operation such as recommending food or recommending ingredients or recipes. In addition, when the order is completed, the digital human may request or make payment from the customer. Of course, in this process, a digital human may make a gesture or transmit a voice to have a conversation with a customer. In addition, when a customer requests to omit a specific ingredient when manufacturing food, the digital human reflects the request and manufactures the food by excluding the specific ingredient. In this case, the final decision can be made by reconfirming it through dialogue. Of course, this operation is to recognize the customer's conversation through voice recognition technology, and the operation to confirm again is possible and visible because it is set through an artificial intelligence program to re-confirm when the conversation is recognized.

In order to perform the above operation, the artificial intelligence digital human according to the embodiment of the present invention may be used with artificial intelligence programs installed in various forms. In order to install such a program, a program developed by a program developer may be provided and installed, but a tool provided by the food service device 120 of FIG. It is also possible to create an artificial intelligence digital human desired by a tool and install and use the program of the created artificial intelligence digital human. For example, an artificial intelligence digital human is an artificial intelligence program, but at the same time, a digital human, that is, a virtual human, can be displayed on a screen to perform the same actions as existing real people, that is, gestures, and to conduct a conversation with a customer.

Usually, artificial intelligence programs operate based on learning data. Learning data can be supervised learning, semi-supervised learning, or unsupervised learning. Supervised learning is when a program developer gives data with correct answers (labels) to an artificial intelligence model and inputs it to learn. Since there is no correct answer in the training data, there is only a problem (input data), so it is a method of discovering patterns and characteristics of problems through learning rather than finding the correct answer to the problem. Semi-supervised learning is a combination of supervised learning and unsupervised learning. Therefore, since the artificial intelligence digital human has already learned labeling data or big data related to customer conversations, it can respond to customer inquiries. Of course, the artificial intelligence digital human can provide not only customer queries, but also gestures and voices corresponding to them through various situational awareness. For example, it is also possible to determine the content of a customer's conversation in consideration of the customer's facial expression. As for the gestures and voices of artificial intelligence digital humans, it will be possible to make movements after learning the gestures and voices of the owner who was dealing with real customers at a restaurant.

In addition, various operations may be performed in relation to the digital human of artificial intelligence. For example, when creating a digital human of artificial intelligence, various races, sizes, etc. can be freely set, and clothing, personality, voice, etc. can be created in various ways through artificial intelligence. For example, if a voice file is provided to use the voice of a store manager, it may be learned and used. Furthermore, if the store owner selects and designates specific clothing provided through the template service of the artificial intelligence generation tool, the service can be made in the form of wearing the clothing by a digital human, and the food sales device 100 in a specific country If you need to install a racial problem, you can create a digital human of a race that matches a specific country and make it appear on the screen. Furthermore, if a specific language is a problem, for example, if you have to deal with a foreigner among users, you can recognize the user's language and language content and set it through a program tool so that the answer is made in the same language that matches it. It is possible to install the corresponding program through the development of a program that reflects the matters of the above.

Above all, the food sales device 100 measures the freshness of ingredients based on an artificial neural network and operates to provide fresh food immediately by applying a recipe and recipe for making optimal fresh food. In this process, the food sales device 100 allows the user to see the digital human manufacturing food through the display device 210 of FIG. that can be manufactured. Of course, since it is possible to synchronize the movement of the cooking robot with the image of the digital human and implement it on the screen, the embodiment of the present invention will not be particularly limited to any one form. For example, when a cooking robot puts a specific ingredient into a container, the video of the digital human can be controlled by synchronizing the time based on the information of the material and the motion information of the robot.

The communication network 110 may be configured in various forms. The communication network 110 may include both wired and wireless communication networks. For example, as the communication network 110, a wired or wireless Internet network may be used or interlocked. Here, the wired network includes an Internet network such as a cable network or a public switched telephone network (PSTN), and the wireless communication network includes CDMA, WCDMA, GSM, EPC (Evolved Packet Core), LTE (Long Term Evolution), and Wibro networks. meaning to include Of course, the communication network 110 according to an embodiment of the present invention is not limited thereto, and may be used as an access network of a next-generation mobile communication system to be implemented in the future, for example, a cloud computing network under a cloud computing environment, a 5G network, and the like. For example, when the communication network 110 is a wired communication network, an access point within the communication network can access an exchange center of a telephone company, but in the case of a wireless communication network, access to an SGSN or GGSN (Gateway GPRS Support Node) operated by a communication company to process data, Data can be processed by connecting to various repeaters such as BTS (Base Transceiver Station), NodeB, and e-NodeB.

The communication network 110 may include an access point. The access point may include a small base station such as a femto or pico base station that is often installed in a building. Here, the femto or pico base station may be classified according to the maximum number of units of the food sales device 100 or the third party device 130 that can be connected to the small base station. Of course, the communication network 110 may include a short-range communication module for performing short-range communication such as ZigBee and Wi-Fi with the food sales device 100 or the third party device 130 . The access point may use TCP/IP or Real-Time Streaming Protocol (RTSP) for wireless communication. Here, short-range communication may be performed in various standards such as Bluetooth, ZigBee, infrared (IrDA), RF (Radio Frequency) such as UHF (Ultra High Frequency) and VHF (Very High Frequency), and ultra-wideband communication (UWB) in addition to Wi-Fi. can Accordingly, the access point can extract the location of the data packet, designate the best communication path for the extracted location, and forward the data packet to the next device, for example, the food service device 120 along the designated communication path. An access point may share several lines in a general network environment, and may include, for example, a router, a repeater, and a repeater.

When the food service device 120 installs the food sales device 100 in the store and applies the artificial intelligence digital human to the corresponding food sales device 100, it not only creates an artificial intelligence digital human but also manages the store. You can perform an action for Of course, the food sales device 100 may also be installed and operated in a plurality of stores. The food service device 120 may collect and analyze data related to operating conditions such as failure of the device from the food sales device 100, but collect and analyze data related to orders or payments made in the food sales device 100. It can also ensure that ingredients for food preparation are provided in a timely manner. The store owner who manages the store can quickly supply the ingredients based on the information provided by the food service device 120 when it is necessary to supply the ingredients.

For example, when recommending food to a customer, the food service device 120 may provide recommendation data to the food selling device 100 so as to recommend ingredients and recipes of the corresponding food. For example, assuming a hamburger, a hamburger can be made using a variety of ingredients. Accordingly, the food service device 120 may recommend or recommend the best (popular) food, and the best food is provided based on the analysis result of big data collected from the food sales devices 100 installed in a plurality of stores. Anything can be possible. Accordingly, the food sales device 100 can recommend food to customers based on the data provided by the food service device 120, and in particular, recommend ingredients and recipes as the digital human learns the corresponding data. .

The third party device 130 includes a computer or server of a program developer that develops and provides an artificial intelligence digital human program according to an embodiment of the present invention, but the food service device 120 according to an embodiment of the present invention It may be configured to include various devices such as a computer of an operator who operates a service and a terminal device such as a smartphone or a computer of a store owner who operates a store. In other words, the third party device 130 may be regarded as a collective term for corresponding devices. For example, in the case of a program developer, it is possible to provide a tool for producing an artificial intelligence digital human according to the store owners' preferences, and accordingly, the store owner who installs and operates the food sales device 100 in the store. They will be able to create and utilize artificial intelligence digital humans according to the guidance or manuals provided by the tool by executing the tool through their own computer. Typically, store owners can set clothes, set voices, or select and set a language, and other than that, it is possible to set a race. Since the details have been sufficiently explained above, we will replace them with the contents.

In addition to the above, the food sales device 100, the communication network 110, the food service device 120, and the third party device 130 of FIG. 1 may be further described later, so detailed information will be given to them. want to replace

FIG. 3 is a block diagram illustrating a detailed structure of the food sales device of FIG. 1 .

As shown in FIG. 3 , the food sales apparatus 100 according to an embodiment of the present invention includes a communication interface unit 300, a display unit 310, a freshness measuring unit 320, a control unit 330, and an ingredient storage unit. 340, includes some or all of the food manufacturing unit 350 and the storage unit 360, and in addition, a sensor (eg, infrared sensor, etc.), a camera, a voice recognition unit such as a microphone for recognizing voice, a speaker, etc. may include more.

Here, "including some or all" means that some components such as the storage unit 360 are omitted to form the food sales device 100, or some components such as the freshness measurement unit 320 are a food manufacturing unit ( 350), which can be integrated into other components such as, etc., and will be described as including all of them to help a sufficient understanding of the invention.

The communication interface unit 300 may include a first communication unit and a second communication unit. Through the first communication unit, communication with the food service device 120 may be performed via the communication network 110 of FIG. 1 . For example, when a store owner who wants to install and operate a food sales device 100 in a store generates and provides an artificial intelligence digital human based on a template through the food service device 120, operation for installing a program for this can be performed. After accessing the food service device 120 and signing up as a member, the store owner can register the identification information of the food sales device 100 operated by the store owner. It can be installed by providing an artificial intelligence digital human program. The communication interface unit 300 may be involved in these operations. This may correspond to remote control type program installation.

On the other hand, the communication interface unit 300 can install the same program in the same way as remote installation through the second communication unit. For example, when a storage medium such as USB is inserted into a specific port, the controller 330 executes an artificial intelligence digital human program stored in the storage medium of the corresponding port to implement an operation according to an embodiment of the present invention. can Furthermore, it may be possible to write a digital human program of artificial intelligence into an EEPROM through a connector or the like, that is, to install it. Even in this case, the controller 330 may execute the corresponding program installed in the EEPROM to perform the operation according to the embodiment of the present invention.

In addition, the communication interface unit 300 may provide data of the food sales device 100 installed in the store to the food service device 120 so as to be monitored, and may operate to monitor the food sales device 100 installed in other stores. ), recommendation data recommended according to the analysis result of the big data collected in ) may be provided to the control unit 330 . Here, the monitoring may include monitoring to determine sales trends as well as monitoring to determine whether the food sales device 100 is out of order. For example, it may be possible to determine the type of food ordered by customers visiting a store or monthly food consumption trends through data analysis. Of course, it may be possible to determine daily, monthly, or annual sales through payment data.

The display unit 310 includes (O) LED elements and can implement an artificial intelligence digital human image on the screen under the control of the controller 330 . The display unit 310 may include a sensor so as to enable a touch on the screen as well as the image panel. The sensor may operate in a resistive or capacitive manner. For example, the display unit 310 may display a recommendation menu on the screen according to the digital human's guidance displayed on the screen. Accordingly, when a user selects a specific food on the screen, it is possible to recognize which food has been selected based on the location of the selected food, and thus, a touch screen capable of touching the screen can be included. In addition, the display unit 310 may be synchronized with, for example, a manufacturing robot constituting the food manufacturing unit 350 under the control of the control unit 330 to control the digital human's gestures and display them on the screen.

The freshness measurement unit 320 is preferably configured adjacent to the material storage unit 340 when actually configuring the food sales device 100 of FIG. 1 . In other words, this is because the freshness of the material must be measured when the material is discharged from the material storage unit 340 to the outside. For example, if the material is discharged from the material storage unit 340 in a conveyor manner, it may be installed and operated in the discharge unit. The freshness measurer 320 may install a camera and determine the freshness of the material based on pixel values through pixel analysis in the photographed image of the material photographed by the camera. For example, an ingredient should be green, but if it is yellow, it can be judged that the freshness of the ingredient is low. In addition, the freshness measurer 320 may also use (atomic) fluorescence spectroscopy. For example, when a material is discharged, a specific light source is provided to the material, and a fluorescence spectrum line unique to the light source is detected at this time. That is, in an embodiment of the present invention, a method of providing a specific light source and detecting its characteristics, such as fluorescence spectroscopy, may be used. For example, in relation to a specific material, the detection value should be a, but if it does not become a or is not within the error range, it can be determined that the freshness has changed. To this end, the freshness measurer 320 may include a light emitting device that provides a light source and a detector that detects spectral lines.

The control unit 330 controls the overall control of the communication interface unit 300, the display unit 310, the freshness measurement unit 320, the material storage unit 340, the food production unit 350 and the storage unit 360 of FIG. 3 responsible for the action For example, the control unit 330 executes the artificial intelligence digital human program stored in the food production unit 350 or the internal memory, and when the customer enters the store, the customer accompanies a gesture (eg, greeting, etc.) or a voice. A speaker or the like may be controlled to output a welcome greeting. Also, the controller 330 may provide a food menu to customers through the display unit 310 and may recommend ingredients or recipes. In addition, the control unit 330 controls the food production unit 350 based on the data measured by the freshness measurement unit 320 when discharging the ingredients of the food selected by the user from the material storage unit 340 to produce food. you can make it In this process, when the food manufacturing unit 350 uses a manufacturing robot, the manufacturing process of the corresponding manufacturing robot and the manufacturing process of the digital human displayed on the screen of the display unit 310 may be synchronized. In other words, when the manufacturing robot puts the ingredient a' into the food, it shows how to put the material on the screen corresponding to the corresponding a' into the food on the screen. Of course, since the digital human image can be implemented in various ways, the embodiment of the present invention will not be particularly limited to any one method. In addition, when a customer requests to omit a specific ingredient, the control unit 330 may control cooking to be performed with the corresponding ingredient subtracted through the food production unit 350 according to the request.

In addition, the controller 330 may collect data from various types of sensors provided in the food sales device 100' and provide the collected data to the food service device 120 of FIG. 1 . In this process, the control unit 330 can control communication of the communication interface unit 300 . In addition, the control unit 330, when data related to food ingredients or recipe recommendations are provided from the food service device 120 of FIG. 1, temporarily stores them in the storage unit 360, calls them out, and provides them to the food production unit 350. Anything is possible. Through this, after learning the corresponding recommendation data, the artificial intelligence digital human can recommend ingredients or recipes to users when recommending food.

Of course, in addition to this, the controller 330 may discharge food that has been manufactured through the food outlet 220 of FIG. 2 , and also process the payment for the food ordered by the user through the payment unit 230 of FIG. 2 . To do this, the communication interface unit 300 may be controlled to communicate with the food service device 120 of FIG. 1 . Through this, the control unit 330 can control the food production unit 350 based on the corresponding information when there is an approval process related to payment from the food service device 120 to perform food production. Of course, it is possible for a manufacturing robot to operate food manufacturing, but it may include implementing the manufacturing process of the food on the screen of the display unit 310 through a digital human.

The material storage unit 340 may refer to a storage room for freezing or refrigerating food ingredients to keep them fresh at an optimal temperature. Like conventional refrigerators, the optimum temperature can be continuously maintained through a temperature sensor. In other words, as a result of checking the temperature through the sensing data of the temperature sensor, the controller 330 generates cold air through a condenser or the like to maintain the temperature when it is out of the designated temperature. Therefore, it can be seen that a temperature sensor or a condenser is configured together with the material storage unit 340 . Material storage unit 340 may discharge a specified amount of material to the outlet in the form of configuring a material outlet at the bottom and configuring a valve at the outlet. At this time, the valve may be controlled by the controller 330 to operate on/off. However, in the case of a manufacturing robot, material discharge may be possible in various forms, such as inserting a robot finger into an open part of the upper part so that an appropriate amount of material is gripped. Therefore, since the configuration of the material storage unit 340 can be formed in various ways, the embodiment of the present invention will not be particularly limited to any one form.

The food production unit 350 may include various components related to food production. For example, manufacturing robots are typical. However, even if the food manufacturing unit 350 is not a manufacturing robot, it is equipped with an artificial intelligence digital human program, executes the program under the control of the controller 330, and outputs graphic data according to the execution. can For example, the food manufacturing unit 350 is equipped with a natural language processing model, i.e., a program, and combines with a voice recognition chatbot to enable chatting or verbal ordering as if ordering to a person, and supports languages of various countries in the process. For example, when a user entering a store tries to communicate by uttering a specific language, a voice signal related to the language or conversation may be acquired through a microphone and the corresponding voice signal may be recognized. And based on the result of recognition, it is possible to determine what type of language it is by comparing it with previously stored data. The type of language is recognized through the user's initial utterance, and then natural language processing is possible through signal analysis of the entire sentence. Natural language processing means that sentence recognition is possible, and a natural language processing program can be used for this purpose. For example, in an embodiment of the present invention, a library such as a language dictionary may be constructed for natural language processing, words of a specific part of speech are processed by comparing with words in the library, and natural language processing of the entire sentence is performed in this way. It could be possible. Artificial intelligence's natural language processing has recently been well known through ChatGPT, so further explanation will be omitted.

The storage unit 360 may temporarily store various types of data processed under the control of the control unit 330 . For example, the storage unit 360 may temporarily store food order data of the user as data processed by the food vending device 100' and payment data when payment is made. In addition, the data may be provided to the food service device 120 via the communication network 110 of FIG. 1 under the control of the controller 330, and through this, the data may be provided to the DB 120a for each store or the food sales device 100 of the store. ) can be systematically classified based on the identification information, stored and managed.

In addition to the above, the communication interface unit 300, the display unit 310, the freshness measurement unit 320, the control unit 330, the material storage unit 340, the food production unit 350, and the storage unit 360 of FIG. 3 ), the sensor, the camera, the voice recognition unit, the speaker, etc. have been fully explained above, so they will be replaced with the contents.

3 according to an embodiment of the present invention, the display unit 300, the display unit 310, the freshness measurement unit 320, the control unit 330, the material storage unit 340, the food production unit 350, and storage The unit 360, the sensor, the camera, the voice recognition unit, and the speaker are composed of physically separated hardware modules, but each module may store and execute software for performing the above operation therein. However, since the corresponding software is a set of software modules, and each module can be formed of hardware, it will not be particularly limited to the configuration of software and hardware. For example, the storage unit 360 may be hardware storage or memory. However, since it is possible to store information in a software manner (repository), the above content will not be particularly limited.

Meanwhile, as another embodiment of the present invention, the control unit 330 may include a CPU and a memory, and may be formed as a single chip. The CPU includes a control circuit, an arithmetic unit (ALU), a command interpreter, and a registry, and the memory may include RAM. The control circuit performs control operation, the operation unit performs operation of binary bit information, and the instruction interpretation unit performs operation of converting high-level language into machine language and machine language into high-level language, including an interpreter or compiler. , the registry may be involved in software data storage. According to the above configuration, for example, the artificial intelligence digital human program stored in the food production unit 350 or the storage unit 360 is copied at the beginning of the operation of the food sales device 100, 100' to memory, that is, RAM ) and then executing it, the data operation processing speed can be rapidly increased. In the case of a deep learning model, it can be loaded into GPU memory rather than RAM, and can be executed by accelerating the execution speed using the GPU.

FIG. 4 is a flowchart illustrating a driving process of the food vending device of FIG. 1 .

Referring to FIG. 4 together with FIG. 1 for convenience of explanation, the food sales apparatus 100 according to the embodiment of the present invention displays an artificial intelligence digital human on the screen (S400). That is, a virtual human operated by an artificial intelligence program is implemented on the screen. Prior to this, the food sales device 100 may perform an operation for loading or installing an artificial intelligence digital human program. In addition to the local method using a storage medium or EEPROM, that is, the method of installing the program on site, this installation process may be performed remotely through the food service device 120 of FIG. 1 in a global method. Since the details have been sufficiently explained above, we will replace them with those contents.

In addition, the food selling device 100 controls the digital human to recommend ingredients and recipes, that is, recipes for manufacturing food ordered by users visiting the store to users, and the digital human manufactures food using ingredients according to the recipe. The process is controlled to be implemented on the screen of the display unit (S410).

In this process, the food selling device 100 may manufacture food by carefully selecting only ingredients guaranteed to have optimum freshness by detecting the freshness of the ingredients by measuring or analyzing and discarding the ingredients whose freshness is below the standard value. In addition, by showing manufacturing through a digital human on the screen together, it is possible to give users confidence.

In addition to the above, the food sales device 100 of FIG. 1 can perform various operations, and since other details have been sufficiently described above, they will be replaced with those contents.

Even though all the components constituting the embodiments of the present invention are described as being combined or operated as one, the present invention is not necessarily limited to these embodiments. That is, within the scope of the object of the present invention, all of the components may be selectively combined with one or more to operate. In addition, although all of the components may be implemented as a single independent piece of hardware, some or all of the components are selectively combined to perform some or all of the combined functions in one or a plurality of pieces of hardware. It may be implemented as a computer program having. Codes and code segments constituting the computer program may be easily inferred by a person skilled in the art. Such a computer program may implement an embodiment of the present invention by being stored in a computer-readable non-transitory computer readable media, read and executed by a computer.

Here, the non-transitory readable recording medium means a medium that stores data semi-permanently and can be read by a device, not a medium that stores data for a short moment, such as a register, cache, or memory. . Specifically, the above-described programs may be provided by being stored in a non-transitory readable recording medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, or ROM.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features of the present invention. you will be able to understand Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting.

100, 100': food sales device 110: communication network
120: food service device 130: third party device
200: body part 210: display device
220: food outlet 230: payment unit
300: communication interface unit 310: display unit
320: freshness measurement unit 330: control unit
340: material storage unit 350: food manufacturing unit
360: storage unit

Claims (10)

As a food sales device,
a display unit displaying an artificial intelligence digital human on a screen; and
Controlling the digital human to recommend ingredients and recipes for manufacturing food ordered by users visiting the store to the users, and the process of the digital human manufacturing the food using the ingredients according to the recipe A control unit that implements the appearance of as an image on the screen of the display unit; including,
The control unit controls the image of the digital human by synchronizing time based on information on the specified material and operation information of the cooking robot when the cooking robot puts a specified ingredient in a container,
The control unit changes the race and clothes of the digital human based on the characteristics of the store where the food sales device is installed or the country, and implements the change on the screen;
The control unit controls the digital human to manufacture food by excluding the specified ingredient when preparing the food by reflecting the request when the user requests to omit the designated ingredient when preparing the food ordered by the user. In the case of ordering the material to be removed, the digital human controls to make a decision by confirming it again through dialogue,
The control unit, when the freshness of the ingredients for producing the food falls below the standard as a result of measuring the freshness, discards the material below the standard and controls to re-discharge and manufacture the food, a food sales device to which artificial intelligence and digital humans are applied. . According to claim 1,
a material storage unit for freezing or refrigerating the material at a designated temperature; and
A freshness measurement unit for measuring the freshness of the ingredients selected from the ingredient storage unit when preparing the food;
Further including, a food sales device applying artificial intelligence and digital human. According to claim 2,
The freshness measuring unit measures freshness by pixel analysis of a photographed image taken when the material is used, or measures freshness by fluorescence spectroscopy using fluorescence spectral lines detected by providing a light source to the material, artificial intelligence and digital Food sales device applying human. delete According to claim 1,
Wherein the control unit recognizes the language and content of the language of the user ordering the food and responds in the same language as the recognized language. As a driving method of a food vending machine,
Displaying, by a display unit, a digital human of artificial intelligence on a screen; and
A process in which the controller controls the digital human to recommend ingredients and recipes for manufacturing food ordered by users visiting the store to the users, and the digital human prepares the food according to the recipe using the ingredients Controlling to implement the appearance of as an image on the screen of the display unit; including,
The control step is
When the cooking robot puts a designated ingredient into a container, the video of the digital human is controlled by synchronizing time based on information of the designated material and operation information of the cooking robot,
The control step is
changing the race and clothes of the digital human based on the characteristics or country of the store where the food selling device is installed and displaying them on a screen;
When the user requests to omit the designated ingredients when preparing the food ordered, the digital human is controlled to manufacture the food by excluding the designated ingredients when preparing the food by reflecting the request, and the user requests that the designated ingredients be omitted. controlling the digital human to make a decision by confirming the order again through a conversation; and
When the freshness of the ingredients for food production falls below the standard as a result of the freshness measurement, the step of discarding the material below the standard and discharging the material again for manufacturing;
Including, a method of driving a food sales device to which artificial intelligence and digital humans are applied. According to claim 6,
Step, by the material storage unit, freezing or refrigerating the material at a specified temperature; and
A freshness measurement unit measuring the freshness of the ingredients selected from the ingredient storage unit when preparing the food;
Further comprising, a method of driving a food sales device to which artificial intelligence and digital humans are applied. According to claim 7,
The step of measuring the freshness,
Food sales using artificial intelligence and digital humans, which measure freshness by pixel analysis of a photographed image taken when the material is used, or measure freshness using a fluorescence spectroscopy method using fluorescence spectral lines detected by providing a light source to the material How to drive the device. delete According to claim 6,
The control step is
A driving method of a food vending machine applying artificial intelligence and digital humans, recognizing the language and content of the language of the user ordering the food and responding in the same language as the recognized language.

Images