CN114820122A

CN114820122A - Food material storage device, terminal device and purchase list generation method

Info

Publication number: CN114820122A
Application number: CN202210429991.XA
Authority: CN
Inventors: 马晓娜; 穆聪聪; 程晋
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-04-22
Filing date: 2022-04-22
Publication date: 2022-07-29

Abstract

The application provides a food material storage device, a terminal device and a purchase list generation method, wherein after the food material storage device receives a menu selection instruction input by a user, a menu food material set and a stock food material set can be obtained, if the stock food material set has stock food material names the same as the menu food material names, and the corresponding menu food material number is greater than the stock food material number, first list information is generated according to the number difference between the menu food material number and the stock food material number and the menu food material names; if the stored food material names which are the same as the recipe food material names do not exist in the stored food material set, second list information is generated according to the recipe food material names and the number of the recipe food materials, and a purchasing list is generated according to the first list information and the second list information, so that the problem that when the food materials in the recipe are purchased, the purchasing list needs to be manually compared and recorded, the situation that the food materials are repeatedly purchased or are missed to purchase easily occurs, and the user experience is facilitated.

Description

Food material storage device, terminal device and purchase list generation method

Technical Field

The application relates to the technical field of communication, in particular to food material storage equipment, terminal equipment and a purchase list generation method.

Background

The food material storage device can provide multiple functions of intelligent management, intelligent storage, menu recommendation, multifunctional reminding and the like of food materials for a user. Taking the food storage device as an example of an intelligent refrigerator, a user can control a display screen of the intelligent refrigerator to display a menu recommendation interface, and select any menu in the menu recommendation interface, so that the display screen displays detailed contents of the menu, for example, the display screen displays cooking food materials, cooking steps, cooking time and the like required by the menu.

In the prior art, the food material storage device can be connected with the internet, and a user can add required food materials in a menu into a shopping cart by one key and buy the required food materials. However, such a food material purchasing method may cause repeated purchasing, for example, the food material a is stored in the food material storage device, and the recipe selected by the user also includes the food material a, and the one-key purchasing of the food material in the recipe may cause repeated purchasing of the food material a, which causes waste of the food material and is not favorable for the user experience.

Disclosure of Invention

The application provides a food material storage device, a terminal device and a purchase list generation method, so that the problem that repeated purchase or food material missing purchase is easy to occur due to the fact that the purchase list needs to be manually compared and recorded when food materials in a menu are purchased is solved, and user experience is facilitated.

In a first aspect, the present application provides a food material storage device, comprising:

a storage chamber is arranged in the box body;

a display for displaying a user interface;

the food material detector is used for acquiring an inside view image of the storage room;

the communicator is used for establishing communication connection with the server;

a controller configured to:

receiving a menu selection instruction input by a user;

in response to the recipe selection instruction, acquiring a recipe food material set and a stock food material set, wherein the recipe food material set comprises recipe food material names and a recipe food material number for the recipe food material names, and the stock food material set comprises stock food material names and a stock food material number for the stock food material names;

if the same inventory food material name as the recipe food material name exists in the inventory food material set and the number of the recipe food materials is larger than the number of the inventory food materials, generating first list information according to the number difference value between the number of the recipe food materials and the number of the inventory food materials and the recipe food material name, and displaying a first purchasing list corresponding to the first list information in the user interface;

if the same inventory food material name as the recipe food material name does not exist in the inventory food material set, generating second list information according to the recipe food material name and the recipe food material quantity, and displaying a second purchasing list corresponding to the second list information in the user interface.

In a second aspect, the present application provides a terminal device, including:

a display for displaying a user interface;

a communicator for establishing a communication connection with a server to obtain a stocked food material set of a food material storage device connected with the server, the stocked food material set comprising a stocked food material name and a stocked food material quantity for the stocked food material name;

a controller configured to:

receiving an input instruction to acquire a control instruction of an inventory food material set of a food material storage device;

responding to the control instruction, sending a control instruction for instructing to acquire an inventory food material set of a food material storage device to a server, wherein the control instruction is used for enabling the server to send a request for acquiring the inventory food material set to the food material storage device and returning the inventory food material set after the request is successful;

receiving the inventory food material set returned by the server, and displaying a menu recommendation list associated with the inventory food material set in the user interface;

receiving a menu selection instruction in the menu recommendation list input by a user;

responding to the menu selection instruction, and acquiring a menu food material set, wherein the menu food material set comprises menu food material names and menu food material numbers aiming at the menu food material names;

In a third aspect, the present application provides a method for generating a purchase list, including:

receiving a menu selection instruction input by a user;

if the same inventory food material name as the recipe food material name exists in the inventory food material set and the number of the recipe food materials is larger than the number of the inventory food materials, generating list information according to the difference value between the number of the recipe food materials and the number of the inventory food materials and the recipe food material name, and displaying a first purchasing list corresponding to the first list information in the user interface;

According to the technical scheme, after a menu selection instruction input by a user is received, a menu food material set and a stock food material set can be obtained, if the stock food material set has stock food material names the same as the menu food material names and the corresponding number of the menu food materials is greater than the number of the stock food materials, first list information is generated according to the number difference value between the number of the menu food materials and the number of the stock food materials and the name of the menu food materials, and a first purchase list corresponding to the first list information is displayed in a user interface; if the stored food material name identical to the recipe food material name does not exist in the stored food material set, second list information is generated according to the recipe food material name and the quantity of the recipe food materials, and a second purchasing list corresponding to the second list information is displayed in a user interface, so that the problem that when the food materials in the recipe are purchased, the purchasing list needs to be manually compared and recorded, the situation that the food materials are repeatedly purchased or are missed to purchase easily occurs, and the user experience is facilitated.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 illustrates a usage scenario of an intelligent refrigerator shown according to an exemplary embodiment;

FIG. 2A is a perspective view of an intelligent refrigerator shown in accordance with an exemplary embodiment of the present application;

FIG. 2B is a schematic diagram illustrating an appearance of an intelligent refrigerator according to an exemplary embodiment of the present application;

FIG. 3 is a schematic diagram of a hardware configuration of an intelligent refrigerator shown in the present application according to an exemplary embodiment;

FIG. 4 is a schematic diagram illustrating interaction between an intelligent refrigerator and a server according to an exemplary embodiment of the present application;

fig. 5 is a schematic view of a food material management interface according to an exemplary embodiment of the present application;

fig. 6 is a schematic view of another food material management interface according to an exemplary embodiment of the present application;

FIG. 7 is a schematic diagram illustrating interaction between an intelligent refrigerator and a server according to an exemplary embodiment of the present application;

FIG. 8 is a schematic diagram of an intelligent side dish interface shown in accordance with an exemplary embodiment of the present application;

FIG. 9 is a schematic diagram of a menu detail interface shown in accordance with an exemplary embodiment of the present application;

FIG. 10 is a schematic illustration of a process for generating a purchase list in accordance with the present application, in accordance with an exemplary embodiment;

FIG. 11 is a schematic illustration of a purchase list interface illustrated in accordance with an exemplary embodiment of the present application;

FIG. 12 is a schematic diagram of a procurement recommendation list interface shown by the present application according to an exemplary embodiment;

FIG. 13 is a schematic illustration of another purchase list interface illustrated in accordance with an exemplary embodiment of the present application;

FIG. 14 is a schematic diagram illustrating interaction between an intelligent refrigerator and a server according to an exemplary embodiment of the present application;

FIG. 15 is a schematic illustration of an image of an interior scene shown in the present application according to an exemplary embodiment;

fig. 16 is a schematic diagram illustrating interaction among a terminal device, an intelligent refrigerator, and a server according to an exemplary embodiment of the present application.

Detailed Description

In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In the description of the present invention, it is to be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, and do not indicate or imply that the referenced devices or elements must have a particular orientation, be constructed and operated in a particular orientation, and thus, are not to be construed as limiting the present invention.

The terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless otherwise specified.

In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.

Fig. 1 schematically illustrates an operation scenario among a food material storage apparatus, a control device and a terminal device according to an exemplary embodiment. As shown in fig. 1, the user may operate the food material storage apparatus 3 through the control device 1, or the user may perform information interaction with the food material storage apparatus 3 through the terminal apparatus 2 connected with the server 4 to operate the food material storage apparatus 3.

In some embodiments, the control device 1 may be a remote controller, and the communication between the remote controller and the food storage apparatus 3 includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc., and the food storage apparatus 3 is controlled by wireless or other wired methods. The wireless mode may be direct connection or non-direct connection, and may be routed or non-routed. The user can input a user command through a button on the remote controller, voice input, control panel input, etc., to control the food storage device 3. Such as: the user can input corresponding control instructions through volume up-down keys, channel control keys, up/down/left/right moving keys, voice input keys, menu keys, on-off keys and the like on the remote controller, so as to realize the function of controlling the food material storage device 3.

In some embodiments, terminal devices 2 such as mobile phones, tablets, computers, laptops, and other smart devices may also be used to control the food storage device 3. The terminal device 2 can realize connection communication with the food storage device 3 through a network communication protocol, and the purposes of one-to-one control operation and data communication are realized.

As also shown in fig. 1, the food material storage apparatus 3 and the terminal apparatus 2 also perform data communication with the server 4 through a plurality of communication means. The food material storage apparatus 3 and the terminal apparatus 2 may be allowed to make a communication connection through a Local Area Network (LAN), a Wireless Local Area Network (WLAN) and other networks. The server 4 can provide various contents and interactions to the food material storage device 3 and the terminal device 2.

In some embodiments, the server 4 may be a cluster or a plurality of clusters, and may include one or more types of servers. Other web service contents such as hot menu and cooking service are provided through the server 4.

In some embodiments, the food storage device 3 may be a device for storing food with intelligent management, such as an intelligent refrigerator, an intelligent freezer, an intelligent wine cabinet, and an intelligent fruit and vegetable cabinet. In a specific implementation manner of the present application, the technical solution of the present application is described by taking the example that the food material storage device is an intelligent refrigerator. First, the structure, function and the like of the intelligent refrigerator will be described in detail.

Fig. 2A is a perspective view of an intelligent refrigerator according to an exemplary embodiment of the present application, and the intelligent refrigerator provided by an embodiment of the present invention is approximately rectangular in shape. The intelligent refrigerator is defined by a storage compartment providing a limited storage space and doors 200(200A-200B) provided at openings of the storage compartment. The storage chamber is a box body with an opening. In the example shown in fig. 2A, the storage compartments include a freezer compartment 100 located below and a refrigerator compartment 101 located above, the freezer compartment 100 and the refrigerator compartment 101 having one or more independent storage spaces, such as a drawer-type compartment included in the freezer compartment 200, and the like, respectively, and a plurality of receiving compartments 101A-101B included in the refrigerator compartment 101, inside which the overhead lamps are located.

In the example shown in fig. 2A, a plurality of drawer compartments pass through the drawer door lid. The refrigerating chamber 101 is divided into left and right sides, which are respectively covered by door closures pivotably mounted on the cabinet.

It should be noted that fig. 2A is an example of the embodiment of the present application, and the illustrated intelligent refrigerator does not constitute a limitation to the intelligent refrigerator provided in the present application. For example, in further embodiments of the present application, the smart refrigerator cabinet is divided into left and right compartments, defining the left compartment as the freezer compartment 100 and the right compartment as the refrigerator compartment 101, and both the freezer compartment 100 and the refrigerator compartment 101 may be covered by a door pivotally mounted on the cabinet. As another example, in further embodiments of the present application, the storage compartments include a refrigerator compartment 101, a freezer compartment 100, and a temperature-changing compartment.

Based on the intelligent refrigerator that above-mentioned embodiment provided, through set up the display in intelligent refrigerator box outside, can make intelligent refrigerator have the display function.

Fig. 2B is an appearance schematic diagram of the intelligent refrigerator according to the exemplary embodiment of the present application, and as shown in fig. 2B, a display is provided on a door of the refrigerating chamber, and the display is embedded in a door body.

In some embodiments, a food material detector may be further disposed on the refrigerator, and the food material detector may be configured to detect the type and quantity of the inventory food materials in the refrigerator, for example, the food material detector may include a camera disposed in the refrigerator, and acquire the type and quantity of the inventory food materials stored in the refrigerator by collecting and analyzing an internal image of the refrigerator, and for example, the food material detector may be a tag reader disposed on a door of the refrigerator, and the tag reader is internally provided with an antenna for reading an RFID tag to identify the RFID tag in a short distance, so as to record the type and quantity of the inventory food materials stored in the refrigerator.

In some embodiments, the screen of the display is flush with the outer surface of the door.

Fig. 3 is a schematic diagram of a hardware configuration of the intelligent refrigerator according to an exemplary embodiment of the present application, and the intelligent refrigerator 3 may include, as an example, a display 210, a controller 220, a plurality of antennas 230 for detecting an RFID tag, a detector 240, a memory 250, and several user input interfaces. The display 210, antenna 230, detector 240, and memory 250 are coupled to the controller 220 through a communication interface. The display 210 is configured to receive the image signal output by the controller 220, display video content and images and a component of the menu control interface, and display a user control UI interface for controlling the intelligent refrigerator 200.

The controller 220 may include one or more processing units, such as a system on a chip (SoC), a Central Processing Unit (CPU), a Microcontroller (MCU), a memory controller, and the like. The different processing units may be separate devices or may be integrated into one or more processors.

In some embodiments, controller 220 communicates with antenna 230 via a serial port.

In some embodiments, the controller 220 includes an RFID module, and the RFID module, the antenna 230 and the RFID tag form an RFID read/write system, the antenna 230 is used for transmitting radio frequency signals between the RFID module and the RFID tag, and the RFID module completes read/write operations on the RFID tag through the antenna 230.

In some embodiments, the RFID module communicates with the antenna through a serial port.

The memory 250 may include one or more memory units, for example, may include a volatile memory (volatile memory), such as: dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), and the like; non-volatile memory (NVM) may also be included, such as: read-only memory (ROM), flash memory (flash memory), and the like. The different memory units may be separate devices, or may be integrated or packaged in one or more processors or communication interfaces, and become a part of the processors or communication interfaces.

The memory 250 has stored therein program instructions and application programs, such as voice applications. The controller 220 may call the program instructions in the memory 250 or run an application program, so that the intelligent refrigerator executes a related method, for example, the method for scanning the food material tags provided in the embodiment of the present application.

The detector 240, including at least a sound collector such as a microphone, may be used to receive the user's voice. Illustratively, a voice signal including a control instruction of the user controlling the smart refrigerator 200. The detector 240 may further include a door opening and closing state sensor, such as a detection magnetic sensitive switch, a mechanical switch, for detecting an opening and closing signal of each door, and transmitting opening and closing state information to the controller 220 while recording the opening and closing state of the door according to the detected opening and closing signal. Illustratively, when the detector detects an opening signal or a closing signal of any one of the doors, the latest switch state information is transmitted to the controller 220.

A user input interface including at least one of a microphone, a touchpad, a sensor, a key, and other input interfaces. Such as: the user can input a user command through voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding command signal, and sends the command signal to the controller 220.

And a communicator 260 for communicating with the server or the terminal device 2 connected to the server.

In some embodiments, the controller 220 may include a voice recognition module, and the voice recognition module further includes a voice parsing unit and a voice command database, so that the intelligent refrigerator can independently perform voice recognition on voice data input by a user and match the recognized voice content with the voice commands in the voice command database.

The number of antennas 230 is not limited in this application. For example, the antenna 230 may include an antenna provided in each of the storage compartments and an antenna provided inside the tag reader, wherein the antenna provided in each of the storage compartments is mainly used to scan the RFID tag in each of the storage compartments to read the tag information of the RFID tag, and the antenna provided inside the tag reader is mainly used to scan the RFID tag on the tag reader to read the tag information of the RFID tag.

In some embodiments, the power of the antennas provided in different storage compartments may be different. And the power of the antenna of each storage chamber can ensure that the antenna can identify the food materials in the chamber, so that the phenomenon that the error identification rate is increased when the power is too high and the food materials in the chambers are not completely identified when the power is too low is avoided. In a specific implementation, the power of the antenna can be determined in advance according to the space size of each storage room, and the power of each antenna is set in the intelligent refrigerator, wherein the larger the space is, the larger the power is.

In some embodiments, the antenna disposed under the tag reader is referred to as a first antenna, and the antenna disposed in the storage compartment is referred to as a second antenna.

Based on the intelligent refrigerator provided by the embodiment of the application, the food materials in the storeroom can be identified by using the RFID tags, and the tag information (such as tag identification) of the RFID tags has a corresponding relation with the food material information of the food materials identified by the tag information, so that the virtual association between the RFID tags and the food material information is realized. In practical application, the food materials pasted with the RFID tags are stored in the intelligent refrigerator, the RFID tags in the storage room are detected through the second antenna to obtain tag information of the food materials, and the food materials identified by the tags are determined according to the incidence relation between the tag information and the food material information.

In some embodiments, the tag information includes a tag code, and a particular code segment in the tag code identifies the tag. The corresponding relation between the identification information of the RFID tag and the food material information is established, and the virtual association of the RFID tag and the food material can be realized. And then, after the tag identification of the RFID tag in the storage room is obtained, the food material corresponding to the RFID tag can be determined according to the tag identification and the pre-established corresponding relation.

In some embodiments, the controller 220 implements the food material management function by running a food material management application, and the application interface provided by the food material management application includes: the method can be used as a food material management interface applying a main interface, a label editing interface for establishing the association relationship between the RFID label and the food material information, a menu display interface for displaying the recommended menu information and the like.

In some embodiments, the controller 220 starts the food material management application in response to a power-on or user-input food material management application start instruction. After the food material management application is started, a user can input a tag editing instruction in the food material management application. In response to the tag editing instruction, the food material management application scans the RFID tag placed on the tag reader by the user through the first antenna to acquire tag information of the RFID tag, such as "a", and displays a tag editing interface. The user can input food material information in the tag editing interface for association with "a". The food material management application receives food material information input by a user and establishes an association relation between the food material information and the 'A'. When the food material management application detects that the RFID tag A exists in the storeroom through the second antenna, the real food material in the storeroom can be determined according to the food material information related to the RFID tag A, and therefore intelligent management of the food material is achieved. It should be understood that when the food management application detects that there is an RFID tag "a" in the storage room through the second antenna, the food item associated with "a" is an existing food item in the storage room.

In some embodiments, the food material information comprises one or more of a food material ID, a food material name, a storage location identification, a number of food materials, a food material shelf life, a start time, and the like. The storage room for storing the food materials can be determined according to the storage position identification. For example, if the storage location identification included in the food material information "apple" is "1", it is determined that "apple" is stored in the refrigerating chamber, and if the storage location identification included in the food material information "apple" is "2", it is determined that "apple" is stored in the freezing chamber. The freshness of the food material can be determined according to the current time, the shelf life of the food material and the starting time. The starting time may be the actual production date of the food material input by the user, such as the production date of bread 2021 year, 5 month and 1 day, or the time when the food material is put into the storage chamber.

In some embodiments, food material information corresponding to existing food materials in the storage room is stored in the local food material information set. The existing food material refers to food material currently stored in the intelligent refrigerator.

In other embodiments, the food material information corresponding to the historical food materials may also be stored in the local food material information set. The historical food materials refer to food materials which were stored in the intelligent refrigerator in the past and are moved out of the intelligent refrigerator at present. In the specific implementation, the existing food materials and the historical food materials can be distinguished through the storage state marks, for example, the food material information marks of the historical food materials are in a moving-out state, and the food material information marks of the existing food materials are in a putting-in state.

In other embodiments, the food material information of the existing food material and the food material information of the historical food material are stored in different food material information sets.

In some embodiments, after the food material management application is started, the food material information of the existing food material is read from the local food material information set, for example, the food material information with the storage state being the put-in state is read. And then displaying a food material management interface according to the food material information of the existing food materials, wherein the food material management interface comprises food material controls drawn according to the food material information, so that the existing food materials in the intelligent refrigerator are displayed in forms of icons, pictures and texts and the like. In addition, various functional controls, such as an RFID tag editing control, a food adding control, a recipe recommending control, and the like, may be displayed in the food material management interface, so that a user may operate the functional controls to trigger the controller 220 to implement corresponding functions.

In some embodiments, the intelligent refrigerator may further include a food material detector and a communicator, wherein the food material detector may be configured to collect an internal view image of the intelligent refrigerator, and the communicator is configured to establish a connection with the server to implement information interaction with the server. The intelligent refrigerator can acquire image information of food materials in the refrigerator through the food material detector and send the image information to the server so as to identify the food materials stored in the intelligent refrigerator through the server.

In some embodiments, the controller of the smart refrigerator may control to automatically identify the food material inside the refrigerator, for example, the controller may control to automatically identify the food material inside the storage chamber every preset time period, or may control to identify the food material inside the refrigerator when it is detected that the refrigerator door is opened or closed. The controller may also identify the food materials in the storage chamber after receiving a control instruction indicating to identify the stock food materials input by the user, for example, a related control for identifying the food materials stored in the smart refrigerator is displayed in a user interface displayed on a display of the smart refrigerator, and the user clicks the control controller to perform an operation of identifying the food materials in the smart refrigerator.

In some embodiments, when the controller controls the food material in the storage chamber to be identified, the food material detector may control the intelligent refrigerator to collect an internal scene image, which includes an image of the food material stored inside the intelligent refrigerator. Wherein, eating the material detector and can include the camera, the quantity of camera can be a plurality ofly, and a plurality of cameras can distributed inside the refrigerator to ensure can gather the inside image in every corner of intelligent refrigerator.

Fig. 4 is an information interaction diagram of a refrigerator and a server according to some embodiments of the present application, as shown in fig. 4, in S401, a controller may control a camera to acquire an internal view image in a storage chamber, and in S402, transmit a food material identification request to the server, where the food material identification request includes the internal view image, in S403, the server may identify an inventory food material image on the internal view image after receiving the food material identification request transmitted by the smart refrigerator, so as to acquire an inventory food material name and an inventory food material quantity corresponding to each food material image on the internal view image, in S404, the server may generate an inventory food material set according to the identified inventory food material name and the inventory food material quantity corresponding to each inventory food material name, and transmit the inventory food material set to the controller, in S405, the controller may respond to the received inventory food material set, to complete the operation of recognizing the internally stored food materials.

In some embodiments, in order to improve the accuracy of the controller controlling the identification of the food material in the storage chamber, the food material detector may further include a weight measurer for detecting the food material at a preset position in the intelligent refrigerator, so as to obtain the weight of the food material at the preset position in the refrigerator. Wherein, the quantity of weight caliber also can be a plurality ofly, distributes respectively in the inside specific position of refrigerator, for example, the inside fresh-keeping storehouse that can be provided with of intelligent refrigerator, the bottom in fresh-keeping storehouse can be provided with the weight caliber, the inside food that can not use quantity as unit accurate measurement such as meat that can be used for the storage of fresh-keeping storehouse. After the controller controls the weight measurer to detect the weight of the food material at the preset position, the internal view image acquired by the camera and the weight of the food material can be sent to the server through the server, the server identifies the internal view image by combining the weight of the food material, so that the name and the quantity of the food material corresponding to each food material image in the internal view image can be more accurately acquired, for example, the names of the food materials including 'food material 1/600 g', 'food material 2/200 g' and 'food material 3/1 kg' and the accurate quantity of the food materials corresponding to each food material name can be identified from the internal view image. And generating a stock food material set according to the recognized food material names and the number of food materials corresponding to each food material name, sending the stock food material set to a controller, and receiving the stock food material set by the controller so as to finish the operation of recognizing the internally stored food materials.

In some embodiments, the controller may control the food material control corresponding to each of the names of the stock food materials to be displayed in the user interface according to each of the names of the stock food materials in the stock food material set, and the food material control may be presented as a style of a stock food material icon to present a user interface as shown in fig. 5, which is specifically an exemplary food material management interface that may display the food material controls corresponding to the stock food materials stored in the storage chamber. The storage room may include a refrigerating chamber 501 and a freezing chamber 502, and the stocked food material icons include, but are not limited to, corresponding stocked food material pictures, stocked food material names, stocked food material numbers, freshness identifiers of stocked food materials, and the like. The pictures of the inventory food materials can be pictographic pictures of the inventory food materials, and the freshness identification of the inventory food materials is used for showing any one or more of the placement time, the remaining time with the expired distance and the expired time of the inventory food materials. It should be understood that the picture of the inventory material, the name of the inventory material, the number of inventory material, and the freshness of the inventory material, etc. can be part of, i.e., included in, the inventory material icon.

In some embodiments, every preset time period, the refrigerator controller may control freshness of stored food materials to be calculated, the controller may trigger to identify the food materials stored in the storage chamber each time a door opening or closing motion is detected, so as to identify whether a newly stored stock food material exists, if a newly stored stock food material exists, record a storage time and a temperature at a storage position of the stock food material, send a stock food material name of the stock food material and a temperature at the storage position to the server, and after receiving the stock food material name and the temperature at the storage position, the server may analyze, based on big data, a shelf life of the stock food material corresponding to the stock food material name, and send the shelf life to the controller.

When the controller identifies food materials inside the refrigerator, the inventory food material set returned by the server can be further screened. In some embodiments, the controller may calculate the freshness of each inventory food material according to the storage time, the expiration date and the current time of each inventory food material, wherein the shorter the time for storing the inventory food material in the refrigerator, the higher the freshness of the inventory food material, the longer the time for storing the inventory food material in the refrigerator exceeds the expiration date, the lower the freshness of the inventory food material, and when the freshness of the inventory food material is lower than a preset threshold, it is determined that the inventory food material is seriously expired, the name of the inventory food material and the number of the inventory food materials corresponding to the inventory food material may be deleted from the inventory food material set, and information for prompting the user that the inventory food material is expired is displayed in the food material management interface as shown in fig. 6.

In some embodiments, as shown in fig. 7, a user may perform a selection operation on any food material control in a user management interface, in S701, a smart controller, in response to the user selecting a specific food material control, sends a recipe recommendation request to a server, where the recipe recommendation request includes the stock food material name and the stock food material quantity for the food material control, in S702, after receiving the stock food material name and the stock food material quantity, the server obtains a number of recipes matching the stock food material name and the stock food material quantity, and generates a recipe recommendation list in S703, in S704, the server sends the recipe recommendation list to a controller, in S705, after receiving the recipe recommendation list returned by the server, in S706, the controller may trigger the display of the smart recipe interface shown in fig. 8, the intelligent dish matching interface comprises an inventory area 801, a dish matching area 802 and a menu recommendation area 803, wherein the inventory area 801 at least displays food material controls corresponding to all inventory food materials stored in the refrigerator, the dish matching area 802 displays food material controls corresponding to the inventory food materials selected by a user, and the menu recommendation area 803 displays a menu recommendation list which is returned by a server and aims at the food material controls selected by the user.

For example, food material controls such as "food material 2", "food material 3" and "food material 4" are displayed in the user interface shown in fig. 7, the user selects the food material control corresponding to "food material 2", the controller controls, in response to the user operation, to display the food material control corresponding to "food material 2" in the dish matching area 802, and sends a recipe recommendation request to the server, where the recipe recommendation request includes information of "food material 2+600 g", and after receiving the information, the server can obtain a plurality of recipes made by applying "food material 2" and generate a recipe recommendation list, where recipes having a number of "food material 2" applied in the recipe recommendation list that is less than or equal to 600g can be recorded in front of the recipe recommendation list, recipes having a number of "food material 2" applied that is greater than 600g can be recorded behind the recipe recommendation list, and the server sends the recipe recommendation list to the controller, the controller may trigger an intelligent recipe interface as shown in fig. 8 in response to receiving the recipe recommendation list, and a recipe area 802 in the intelligent recipe interface may display a recipe icon corresponding to each recipe in the recipe recommendation list, where the recipe icon includes, but is not limited to, a recipe picture, a recipe name, and the like corresponding to the recipe, and it should be understood that the recipe picture, the recipe name, and the like may be a part of, that is, included in, the recipe icon.

In some embodiments, a user may perform a selection operation on two or more food material controls at the same time, for example, the user may perform a selection operation on both food material controls corresponding to "food material 2" and "food material 3", the controller may control the food material controls corresponding to "food material 2" and "food material 3" to be displayed in the side dish area 802, and send a recipe recommendation request to the server, where the recipe recommendation request includes information of "food material 2+600 g" and "food material 3+200 g", and after receiving the information, the server may obtain a plurality of recipes made by applying "food material 2" and "food material 3" and generate a recipe recommendation list, where the recipes with the number of "food material 2" and "food material 3" being less than or equal to 600g and the number of "food material 3" being less than or equal to 200g in the recipe recommendation list may be recorded in front of the recipe recommendation list, the recipes applying the food materials with the number of the food material 2 being more than 600g and the number of the food material applying the food material 3 being more than 200g can be recorded behind the recipe recommendation list, the server sends the recipe recommendation list to the controller, and the controller can trigger and display an intelligent dish matching interface comprising the corresponding recipe recommendation list in response to receiving the recipe recommendation list.

In some embodiments, a user may select any one of menu icons in the menu recommendation list, the controller sends a menu acquisition request to the server in response to the user's operation, the menu acquisition request includes an identifier of the menu icon selected by the user, and after receiving the menu acquisition request, the server may match corresponding menu information according to the identifier of the menu icon, where the menu information at least includes a menu food material set required for making the menu, and the menu food material set includes a menu food material name and a menu food material number.

In some embodiments, after the server matches the menu information corresponding to the identifier of the received menu, the menu information may be sent to the intelligent refrigerator, and the refrigerator controller may trigger and display a menu detail interface after responding to the received menu information, where the menu detail interface at least includes a menu food material control needed when the menu is made, the menu food material control may be presented as a style of a menu food material icon, and the menu food material icon includes, but is not limited to, a corresponding menu food material picture, a menu food material name, a menu food material number, and the like. It should be understood that the menu food material picture, the menu food material name, the menu food material number, etc. may be part of, i.e., included in, the menu food material icon.

In some embodiments, after the intelligent refrigerator receives the recipe information sent by the server, the refrigerator controller may compare each recipe food material name in the recipe food material set with a stored food material name in the stored food material set, if the stored food material name identical to the recipe food material name exists in the stored food material set, it is indicated that the food material is stored in the refrigerator, and further compare the number of the recipe food materials and the number of the stored food materials of the food material to determine whether the number of the food material stored in the refrigerator meets the requirement for making the recipe, if the number of the stored food materials of the food material is greater than the number of the recipe food materials, add a stored identity to the recipe food material name corresponding to the food material, after comparing the recipe food material set and the stored food material set, trigger to display a recipe detail interface, in which a state of the recipe food material corresponding to which the stored identity is added changes, the user is prompted that the enough number of the menu food materials is stored in the refrigerator, and the requirement for making the menu can be met. For example, after comparing the recipe food material set and the inventory food material set and adding the refrigerator inventory identifier to the recipe food material name in the recipe food material set, the user interface may be refreshed to display a recipe detail interface as shown in fig. 9 in the user interface, where the recipe food material control marked by the inventory icon 900 and the recipe food material control not marked by the inventory icon 900 are displayed in the recipe detail interface.

In some embodiments, the recipe detail interface may further include a purchase control 910, as shown in fig. 10, in S101, the controller may control, in response to a user selecting the purchase control 910, to compare the recipe food material set and the inventory food material set in S102, if an inventory food material name identical to the recipe food material name exists in the inventory food material set, in S103, the controller controls whether the number of the comparison inventory food materials is greater than the number of the recipe food materials, if not, in S104, a difference value between the recipe food materials and the inventory food materials is calculated, and in S105, first list information is generated according to the number difference value between the number of the recipe food materials and the number of the inventory food materials and the recipe food material name.

If there is no stocked food material name in the stocked food material set that is the same as the recipe food material name, in S106, the controller may generate second list information according to the recipe food material name and the recipe food material number.

Illustratively, the set of inventory food materials includes food material 1/100g, food material 2/80g, and food material 3/20g, and the set of recipe food materials includes 1/100g, food material 2/500g, food material 3/10g, food material 9/50g, food material 14/1kg, and food material 15/200g, by comparing the set of inventory food materials and the set of recipe food materials, a first list information and a second purchase list can be generated, wherein the first purchase list includes food material 2/420g, the second purchase list includes food material 9/50g, food material 14/1kg, and food material 15/200g, and since the inventory quantities of food material 1 and food material 3 are respectively greater than the recipe quantities of food material 1 and food material 3, food material 1 and food material 3 need not be recorded in any purchase list.

In some embodiments, after the controller controls the generation of the first list information and the second list information, in S107 and S108, the display of the purchase list interface may be triggered according to the first list information and the second list information, so as to display a first purchase list corresponding to the first list information and a second purchase list corresponding to the second list information in the purchase list page as shown in fig. 11.

In some embodiments, the recipe acquisition request sent by the intelligent refrigerator to the server may further include an identifier of a recipe icon selected by the user and a set of inventory food materials, after the server receives the recipe acquisition request, corresponding recipe information may be matched according to the identifier of the recipe icon, the recipe information at least includes a set of recipe food materials required for making the recipe, the set of recipe food materials includes names of the recipe food materials and the number of the recipe food materials, the server may compare the set of recipe food materials with the set of inventory food materials, if the number of the inventory food materials identical to the name of the recipe food materials exists in the set of inventory food materials and the number of the recipe food materials is greater than the number of the inventory food materials, and first list information may be generated according to the difference between the number of the recipe food materials and the number of the inventory food materials and the name of the recipe food materials. If the same name of the stock food materials as the name of the recipe food materials does not exist in the stock food material set, second list information can be generated according to the name of the recipe food materials and the number of the recipe food materials.

In some embodiments, the server may send the menu information, the first list information, and the second list information to the intelligent refrigerator, the refrigerator controller triggers and displays a menu detail interface and/or a purchase list interface in response to receiving the menu information, the first list information, and the second list information, where the menu detail interface at least includes a menu food material control corresponding to a menu food material required when making the menu, and the purchase list interface at least includes a first purchase list corresponding to the first list information and a second purchase list corresponding to the second list information.

In some embodiments, the purchase list interface further includes a shopping cart control 111, the controller responsive to user selection of the shopping cart control 111, a purchase request may be sent to the server, the purchase request including first listing information corresponding to the first purchase manifest and second listing information corresponding to the second purchase manifest, the purchase request is used for requesting the server to return a purchase recommendation list, the purchase recommendation list at least comprises purchase links aiming at the first list information and the second list information, after the intelligent refrigerator receives the purchase recommendation list returned by the server, it may be controlled to display a purchase recommendation list interface as shown in fig. 12 in the user interface, which may include a name of food material, a number of food materials, a purchase link, a purchase price, and the like on the displayed purchase list.

In some embodiments, after the controller controls generation of the first list information and the second list information, the first list information and the second list information may be merged to generate third list information, and according to the third list information, the controller triggers display of a purchase list interface, so as to display a third purchase list corresponding to the third list information in the purchase list interface as shown in fig. 13.

In some embodiments, the controller controls to compare the recipe food material set and the inventory food material set in response to the user selecting the purchase control 910, and when the inventory food material set has an inventory food material name identical to the recipe food material name and the number of the recipe food materials is greater than the number of the inventory food materials, the recipe food material control corresponding to the recipe food material in the selected state may be displayed in a recipe detail interface.

When the same inventory food material name as the recipe food material name exists in the inventory food material set and the number of the recipe food materials is greater than the number of the inventory food materials, the controller can control and calculate the number difference value between the number of the recipe food materials and the number of the inventory food materials, and the recipe food material control in the selected state displayed in the recipe detail interface at least comprises the recipe food material name and the difference value.

In some embodiments, when the same stock food material name as the recipe food material name does not exist in the stock food material set, a recipe food material control corresponding to the recipe food material in the selected state is still displayed in the recipe detail interface, wherein the recipe food material control at least comprises the recipe food material name and the recipe food material number.

In some embodiments, when the same stocked food material name as the recipe food material name exists in the stocked food material set and the number of stocked food materials is greater than the number of recipe food materials, a recipe food material control corresponding to the recipe food material which is not in the selected state may be displayed in a recipe detail interface.

In some embodiments, a user may select the recipe food material control shown in fig. 9, and the controller responds to the user's operation, and if it is detected that the name of the recipe food material included in the recipe food material control is marked with the inventory identifier, generates and displays a reminding interface to prompt the user that the inventory of the food material is sufficient. If the fact that the name of the menu food material included by the menu food material control is not marked with the inventory identification is detected, the menu food material control can be directly controlled to be in the selected state.

In some embodiments, a user selects a shopping cart control in a menu detail interface, and the controller, in response to the user operation, may generate list information of food materials to be purchased according to the menu food material control in the selected state, where the list information of the food materials to be purchased includes a menu food material name corresponding to the menu food material control in the selected state and a number of food materials to be purchased corresponding to the menu food material name. And sending a purchase request to a server, where the purchase request includes the list information of the food material to be purchased, the purchase request is used to request the server to return to a purchase recommendation list, the purchase recommendation list at least includes a purchase link for the list information of the food material to be purchased, and after receiving the purchase recommendation list returned by the server, the controller may control a user interface to display a purchase recommendation list interface as shown in fig. 12.

In some embodiments, the recipe detail interface may further include a positioning control 920 corresponding to each recipe food material control, as shown in fig. 14, after the user selects any positioning control 920, in S141, the controller sends, in response to the user' S operation, a positioning request to the server, where the positioning request includes a name of the stock food material and a context image collected by the food material detector, the positioning request is used to request the server to mark a position of the image of the stock food material in the context image and return the marked context image, and in S142, the controller may display the marked context image in the user interface in response to receiving the marked context image returned by the server. For example, after a user selects a positioning control bound to food material 1 in a menu detail interface, the controller sends a positioning request to the server in response to the user's operation, where the positioning request includes a food material name of the food material 1 and an internal scene image collected by the food material detector, after receiving the positioning request, the server may mark the position of the food material 1 image in the internal scene image and return the marked internal scene image, and after receiving the marked internal scene image returned by the server, the controller may display the marked internal scene image as shown in fig. 15 in the user interface, where a detection box 151 is displayed in the internal scene image, and the detection box 151 is used to indicate the position of the food material 1.

In some embodiments, the intelligent refrigerator may be connected to other terminal devices through a server, where the terminal device may be any device with a display function, such as a mobile phone, a tablet computer, and a wearable device, and the controller of the intelligent refrigerator may control to upload the inventory food material set and the list information corresponding to the purchase list to the server, and forward the list information to the terminal device through the server, for example, after the intelligent refrigerator receives a sharing instruction indicating to share the purchase list input by a user, the refrigerator controller may trigger to display a user list on the user interface in response to the sharing instruction, where the user list includes at least one device identifier of the terminal device connected to the server, the user performs a selection operation on the device identifier in the user list, and the controller may send a synchronization instruction to the server in response to the selection operation on the device identifier, the synchronization instruction comprises the device identifier and list information corresponding to the purchase list, and the synchronization instruction is used for instructing the server to send the list information corresponding to the purchase list to the terminal device according to the device identifier, so that the purchase list can be displayed on the terminal device.

According to the above embodiments, the present application further provides a terminal device, including a display, a communicator and a controller, where the display may display a user interface; the communicator can establish communication connection with a server so that the terminal equipment can perform information interaction with an intelligent refrigerator connected with the server through the server; the controller is used for executing a corresponding control program.

In some embodiments, referring to fig. 16, an application program associated with the smart refrigerator may be installed on the terminal device, in S161, after a user inputs a control instruction for starting the application program to the terminal device, in response to the instruction input by the user, the application program is executed and a control instruction for instructing to obtain an inventory food material set of the smart refrigerator may be sent to the server, where the control instruction is used for causing the server to send a request for obtaining the inventory food material set to the smart refrigerator, and in S162, after the smart refrigerator agrees to the inventory food material set request, the inventory food material set may be sent to the server, where the inventory food material set at least includes an inventory food material name and an inventory food material quantity corresponding to inventory food materials stored in the smart refrigerator; in S163, the terminal device may trigger to display an intelligent side dish interface in the user interface in response to the received inventory food material set returned by the server, where the intelligent side dish interface displays an inventory food material control generated according to the inventory food material set.

The method comprises the steps that a user selects any stock food control, a controller responds to the user and can send a menu recommendation request to a server, the menu recommendation request comprises a stock food name and a stock food quantity corresponding to the stock food control selected by the user, the server receives the stock food name and the stock food quantity, acquires a plurality of menus matched with the stock food name and the stock food quantity, generates a menu recommendation list and sends the menu recommendation list to a terminal device, the terminal device can trigger and display the menu recommendation list after responding to the received menu recommendation list returned by the server, and the menu recommendation list comprises at least one menu icon aiming at the stock food name and the stock food quantity.

In some embodiments, in response to an operation of a user selecting any menu icon in the menu recommendation list, the terminal device may send a menu acquisition request to the server, where the menu acquisition request includes an identifier of the menu icon selected by the user, and after the server receives the menu acquisition request, the server may match corresponding menu information according to the identifier of the menu icon and send the menu information to the controller, where the menu information at least includes a menu food material set required for making the menu, and the menu food material set includes a menu food material name and a menu food material number.

In some embodiments, after receiving the recipe information sent by the server, the terminal device may compare each name of the recipe food materials in the recipe food material set with the names of the inventory food materials in the inventory food material set, if the inventory food materials with the same names as the recipe food materials exist in the inventory food material set, it is indicated that the food materials are stored in the refrigerator, and further compare the number of the recipe food materials and the number of the inventory food materials of the food materials to determine whether the number of the food materials stored in the refrigerator meets the requirement for making the recipe, if the number of the recipe food materials of the food materials is greater than the number of the inventory food materials, add an inventory identifier to the name of the recipe food materials corresponding to the food materials, after comparing the recipe food material set with the inventory food material set, may trigger to display a recipe detail interface, in which the state of the recipe control corresponding to the name of the recipe food materials to which the inventory identifier is added changes, for example, an inventory icon is displayed beside the menu food material control to prompt a user that the menu food materials are stored in a sufficient amount in a refrigerator, so that the requirement for making the menu can be met. For example, after comparing the recipe food material set and the inventory food material set and adding the refrigerator inventory identifier to the recipe food material name in the recipe food material set, the user interface may be refreshed to display a recipe detail interface in which a recipe food material control marked by an inventory icon and a recipe food material control not marked by an inventory icon are displayed.

In some embodiments, the recipe detail interface may further include a purchase control, and the terminal device may compare the recipe food material set and the inventory food material set in response to a selection operation of the user on the purchase control, and if the inventory food material set includes inventory food material names identical to the recipe food material names and the recipe food material number is greater than the inventory food material number, may generate the first list information according to a number difference between the recipe food material number and the inventory food material number and the recipe food material names. If the same name of the stock food materials as the name of the recipe food materials does not exist in the stock food material set, second list information can be generated according to the name of the recipe food materials and the number of the recipe food materials.

In some embodiments, after the terminal device controls generation of the first list information and the second list information, a purchase list interface may be triggered and displayed according to the first list information and the second list information, and both a first purchase list corresponding to the first list information and a second purchase list corresponding to the second list information are displayed in the purchase list interface.

In some embodiments, the recipe acquisition request sent by the terminal device to the server may further include an identifier of a recipe icon selected by the user, after the server receives the recipe acquisition request, the server may match corresponding recipe information according to the identifier of the recipe icon, the recipe information at least includes a recipe food material set required for making the recipe, the recipe food material set includes a recipe food material name and a recipe food material number, then, the server sends an inventory food material acquisition request to the smart refrigerator to acquire an inventory food material set stored in the smart refrigerator, after the server receives the inventory food material set sent by the smart refrigerator, the recipe food material set and the inventory food material set may be compared, if an inventory food material name identical to the recipe food material name exists in the inventory food material set, and the recipe food material number is greater than the inventory food material number, a first table may be generated according to a number difference between the recipe food material number and the inventory food material number and the recipe food material name List information. If the same name of the stock food materials as the name of the recipe food materials does not exist in the stock food material set, second list information can be generated according to the name of the recipe food materials and the number of the recipe food materials.

In some embodiments, the server may send the menu information, the first list information, and the second list information to the terminal device, and the controller of the terminal device triggers and displays a menu detail interface and/or a purchase list interface in response to receiving the menu information, the first list information, and the second list information, where the menu detail interface at least includes a menu food material control corresponding to a menu food material required when making the menu, and the purchase list interface at least includes a first purchase list corresponding to the first list information and a second purchase list corresponding to the second list information.

In some embodiments, the purchase list interface further includes a shopping cart control, the terminal device responsive to user selection of the shopping cart control, a purchase request may be sent to the server, the purchase request including the first list information and the second list information, the purchase request is used for requesting the server to return a purchase recommendation list, the purchase recommendation list at least comprises purchase links aiming at the food materials to be purchased in the first list information and the second list information, after the terminal equipment receives the purchase recommendation list returned by the server, the purchase recommendation list interface can be controlled to be displayed in the user interface, and the purchase recommendation list interface can include the food material names, the food material quantities, the purchase links, the purchase prices and the like of the food materials to be purchased corresponding to the first list information and the second list information.

The UI respectively takes the intelligent refrigerator and the terminal device as examples, the interactive content takes the intelligent refrigerator, the server and the intelligent terminal as examples, and the UIs of the intelligent refrigerator and the terminal device of other types when generating the purchase list are basically similar to the UI, and are not listed one by one here. The UI interface provided in the present application is merely exemplary, and is subject to practical application and design.

According to the above embodiments, the present application further provides a method for generating a purchase list, which may be executed on the smart refrigerator side, where the execution subject of the method is a controller in the smart refrigerator. The method comprises the following steps:

s100: and receiving a menu selection instruction input by a user.

In some embodiments, prior to receiving the user-input recipe selection instruction, the method further comprises receiving a user-input control instruction indicating to identify inventory food material; responding to the control instruction, sending a food material identification request to a server, wherein the food material identification request comprises the internal scene image, and the food material identification request is used for requesting the server to identify the internal scene image and returning the inventory food material set; receiving the inventory food material set returned by the server; and displaying a food material control aiming at the name of the stock food materials and the number of the stock food materials on the user interface according to the stock food material set.

In some embodiments, the method further comprises receiving a selection operation of the food material control by a user; in response to the selection operation of the food material control, sending a recipe recommendation request to the server, wherein the recipe recommendation request comprises the stock food material name and the stock food material quantity for the food material control; receiving a menu recommendation list returned by a server in response to the menu recommendation request, wherein the menu recommendation list comprises at least one menu aiming at the food material name and the number of the menu food materials; displaying the menu recommendation list on the user interface.

S120: in response to the recipe selection instruction, acquiring a recipe food material set and a stock food material set, wherein the recipe food material set comprises recipe food material names and a recipe food material number for the recipe food material names, and the stock food material set comprises stock food material names and a stock food material number for the stock food material names.

In some embodiments, the obtaining the recipe food material set and the inventory food material set further includes adding an inventory identifier to the recipe food material name if the inventory food material name identical to the recipe food material name exists in the inventory food material set and the number of the recipe food materials is greater than the number of the inventory food materials; displaying a menu food material list in the user interface according to the menu food material set added with the inventory identification, wherein the menu food material list at least comprises the name of the menu food material, the number of the menu food materials and the inventory identification added aiming at the name of the menu food material.

In some embodiments, the obtaining the set of recipe food materials and the set of inventory food materials further comprises calculating a freshness of the inventory food materials based on a current time and a time of inventory food materials being stored in the store; deleting the inventory food material name and the inventory food material quantity of the inventory food material from the set of inventory food materials if the freshness is below a threshold.

In some embodiments, the obtaining the recipe food material set and the inventory food material set further includes sending a positioning request to the server if the inventory food material name identical to the recipe food material name exists in the inventory food material set and the inventory food material number is greater than the recipe food material number, where the positioning request includes the inventory food material name and the intra-scene image, and the positioning request is used to request the server to mark the position of the inventory food material image in the intra-scene image and return the marked intra-scene image; receiving the marked internal scene image returned by the server; displaying the context image in the user interface.

S130: if the same inventory food material name as the recipe food material name exists in the inventory food material set and the number of the recipe food materials is larger than the number of the inventory food materials, generating first list information according to the number difference value of the number of the recipe food materials and the number of the inventory food materials and the recipe food material name, and displaying a first purchasing list corresponding to the first list information in the user interface.

S140: if the same inventory food material name as the recipe food material name does not exist in the inventory food material set, generating second list information according to the recipe food material name and the recipe food material quantity, and displaying a second purchasing list corresponding to the second list information in the user interface.

In some embodiments, the method further includes sending a purchase request to the server, the purchase request including the first list information and the second list information, the purchase request for requesting the server to return a purchase recommendation list, the purchase recommendation list including at least a purchase link for the first list information and the second list information; receiving a purchase recommendation list returned by the server; displaying the purchase recommendation list in the user interface.

In some embodiments, the method further comprises receiving a sharing instruction input by the user and indicating to share the purchase list; responding to the sharing instruction, displaying a user list on the user interface, wherein the user list comprises a device identifier of a terminal device connected with the server; receiving a selection operation of a user on the equipment identifier in the user list; and responding to the selected operation of the equipment identifier, sending a synchronization instruction to the server, wherein the synchronization instruction comprises the equipment identifier, the first list information and the second list information, and the synchronization instruction is used for indicating the server to send the first list information and the second list information to the terminal equipment according to the equipment identifier.

The same and similar parts in the embodiments in this specification may be referred to one another, and are not described herein again.

In a specific implementation, the present invention further provides a computer storage medium, where the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in each embodiment of the method for generating a purchase list provided by the present invention. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A food material storage apparatus, comprising:

a storage chamber is arranged in the box body;

a display for displaying a user interface;

a controller configured to:

receiving a menu selection instruction input by a user;

2. The food material storage device of claim 1, wherein prior to the step of receiving a user-input recipe selection instruction, the controller is further configured to:

receiving a control instruction which is input by a user and indicates to identify the inventory food material;

responding to the control instruction, sending a food material identification request to a server, wherein the food material identification request comprises the internal scene image, and the food material identification request is used for requesting the server to identify the internal scene image and returning the inventory food material set;

receiving the inventory food material set returned by the server;

and displaying a food material control aiming at the stock food material name on the user interface according to the stock food material set.

3. The food material storage device of claim 2, wherein the controller is further configured to:

receiving the selection operation of the user on the food material control;

in response to the selection operation of the food material control, sending a recipe recommendation request to the server, wherein the recipe recommendation request comprises the stock food material name and the stock food material quantity for the food material control;

receiving a menu recommendation list returned by a server in response to the menu recommendation request, wherein the menu recommendation list comprises at least one menu aiming at the food material name and the number of the menu food materials;

displaying the menu recommendation list on the user interface.

4. The food material storage facility of claim 1, wherein in the acquiring a set of recipe food materials and a set of inventory food materials step, the controller is further configured to:

if the same stock food material name as the recipe food material name exists in the stock food material set and the number of the stock food materials is larger than the number of the recipe food materials, adding a stock identification to the recipe food material name;

displaying a menu food material list in the user interface according to the menu food material set added with the inventory identification, wherein the menu food material list at least comprises the name of the menu food material, the number of the menu food materials and the inventory identification added aiming at the name of the menu food material.

5. The food material storage facility of claim 1, wherein in the acquiring a set of recipe food materials and a set of inventory food materials step, the controller is further configured to:

calculating the freshness of the stock food materials according to the current time and the time for storing the stock food materials in the storage room;

deleting the inventory food material name and the inventory food material quantity of the inventory food material from the set of inventory food materials if the freshness is below a threshold.

6. The food material storage device of claim 1, wherein the controller is further configured to:

sending a purchase request to the server, the purchase request including the first purchase list and the second purchase list, the purchase request being used to request the server to return a purchase recommendation list, the purchase recommendation list including at least purchase links for the first purchase list and the second purchase list;

receiving a purchase recommendation list returned by the server;

displaying the purchase recommendation list in the user interface.

7. The food material storage device of claim 1, wherein the controller is further configured to:

receiving a sharing instruction which is input by a user and indicates to share the purchasing list;

responding to the sharing instruction, displaying a user list on the user interface, wherein the user list comprises a device identifier of a terminal device connected with the server;

receiving a selection operation of a user on the equipment identifier in the user list;

and responding to the selected operation of the equipment identifier, sending a synchronization instruction to the server, wherein the synchronization instruction comprises the equipment identifier, the first purchase list and the second purchase list, and the synchronization instruction is used for instructing the server to send the first purchase list and the second purchase list to the terminal equipment according to the equipment identifier.

8. The food material storage facility of claim 1, wherein in the acquiring a set of recipe food materials and a set of inventory food materials step, the controller is further configured to:

if the same inventory food material name as the recipe food material name exists in the inventory food material set and the quantity of the inventory food material is greater than the quantity of the recipe food material, sending a positioning request to the server, wherein the positioning request comprises the inventory food material name and the internal view image, and is used for requesting the server to mark the position of the inventory food material image in the internal view image and returning the marked internal view image;

receiving the marked internal scene image returned by the server;

displaying the internal view image in the user interface.

9. A terminal device, comprising:

a display for displaying a user interface;

a controller configured to:

10. A method for generating a purchase list, comprising:

receiving a menu selection instruction input by a user;