WO2023202221A1

WO2023202221A1 - Electronic device and data processing method

Info

Publication number: WO2023202221A1
Application number: PCT/CN2023/078530
Authority: WO
Inventors: 马晓娜; 穆聪聪; 程晋; 卢可敬; 王全强; 李金昆
Original assignee: 海信视像科技股份有限公司
Priority date: 2022-04-22
Filing date: 2023-02-27
Publication date: 2023-10-26
Also published as: WO2023202221A9

Abstract

The present application discloses an electronic device and a data processing method. The electronic device comprises: a display, used for displaying content; a communicator, used for communicating with an external device; a processor, the processor being communicatively connected to the display, and the processor being configured to: determine food ingredient request information in response to a recipe recommendation operation, the food ingredient request information being used for obtaining food ingredient information locally stored by a food ingredient storage device; obtain a recipe according to the food ingredient information; and control the display to display the recipe. Recipe recommendations matching actual food ingredients can be displayed.

Description

An electronic device and data processing method

Cross-references to related applications

This application claims priority to the Chinese patent application submitted on April 22, 2022, with application number 202210429991. priority of the Chinese patent application, the entire content of which is incorporated into this application by reference.

Technical field

The present application relates to the field of display technology, and in particular, to an electronic device and a data processing method.

Background technique

Currently, users often buy a lot of vegetables but don’t know what they can make. Recipe recommendations allow users to clearly see the recipes corresponding to the ingredients they bought, so they can choose their favorite dishes to cook.

In current devices, recipe recommendation is an important function that embodies intelligence. However, if recipe recommendations cannot be based on the ingredients actually stored by the user, only default recommendations can be displayed, causing a serious problem that is far from the actual ingredient information.

How to display recipe recommendations that match actual ingredients is worth studying.

Contents of the invention

This application provides an electronic device and a data processing method.

An embodiment of the present application discloses an electronic device, including: a display, used to display content; a communicator, used to communicate with external devices; a processor, the processor is communicatively connected to the display, and the processor is configured The steps are: in response to the operation of recipe recommendation, determine the ingredient request information, and the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device; obtain the recipe according to the ingredient information; and control the display to display the recipe.

An embodiment of the present application discloses a data processing method, which includes: an electronic device determines ingredient request information in response to an operation of recipe recommendation, and the ingredient request information is used to obtain ingredient information stored locally by an ingredient storage device; according to the ingredient The information obtains the recipe; the electronic device controls its display to display the recipe.

Description of the drawings

Figure 1 is a schematic diagram of an operation scenario between a display device and a control device according to some exemplary embodiments of the present application;

Figure 2 is a hardware configuration block diagram of the control device 100 shown in this application according to some exemplary embodiments;

Figure 3 is a hardware configuration block diagram of the display device 200 shown in this application according to some exemplary embodiments;

Figure 4A is one of the flow diagrams of the data processing method shown in this application according to some exemplary embodiments;

Figure 4B is the second schematic flowchart of the data processing method shown in this application according to some exemplary embodiments;

Figure 5 is a schematic diagram of the display effect of the recipe recommendation interface shown in this application according to some exemplary embodiments;

Figure 6 is a schematic flow chart of obtaining the LAN address of a device according to some exemplary embodiments of this application;

Figure 7 is a schematic diagram of the communication connection relationship of devices in the local area network shown in this application according to some exemplary embodiments;

Figure 8 is a schematic flowchart of another example of a data processing method shown in this application according to some exemplary embodiments;

Figure 9 is a usage scenario diagram of a smart refrigerator shown in this application according to some exemplary embodiments;

Figure 10A is a perspective view of a smart refrigerator shown in this application according to some exemplary embodiments;

Figure 10B is a schematic diagram of the appearance of a smart refrigerator according to some exemplary embodiments of the present application;

Figure 11 is a schematic diagram of the hardware configuration of a smart refrigerator shown in this application according to some exemplary embodiments;

Figure 12 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments;

Figure 13 is a schematic diagram of an ingredient management interface shown in this application according to some exemplary embodiments;

Figure 14 is a schematic diagram of another food material management interface shown in this application according to some exemplary embodiments;

Figure 15 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments;

Figure 16 is a schematic diagram of an intelligent dish preparation interface shown in this application according to some exemplary embodiments;

Figure 17 is a schematic diagram of a recipe details interface shown in this application according to some exemplary embodiments;

Figure 18 is a schematic flow chart of generating a purchase list according to some exemplary embodiments of this application;

Figure 19 is a schematic diagram of a purchase list interface shown in this application according to some exemplary embodiments;

Figure 20 is a schematic diagram of the procurement recommendation list interface shown in this application according to some exemplary embodiments;

Figure 21 is a schematic diagram of another purchase list interface shown in this application according to some exemplary embodiments;

Figure 22 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments;

Figure 23 is a schematic diagram of an interior image shown in this application according to some exemplary embodiments;

Figure 24 is a schematic diagram of the interaction between a terminal device, a smart refrigerator and a server according to some exemplary embodiments of this application.

Detailed ways

In order to make the purpose and implementation of the present application clearer, the exemplary embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only for the purpose of this application. Apply for some of the embodiments, not all of them.

It should be noted that the brief description of terms in this application is only to facilitate understanding of the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood according to their ordinary and usual meaning.

FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to some exemplary embodiments of the present application. As shown in FIG. 1 , the user can operate the display device 200 through the terminal device 2 or the control device 100 .

In some embodiments, the control device 100 may be a remote controller. The communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods to control the display device 200 through wireless or wired methods. The user can control the display device 200 by inputting user instructions through buttons on the remote control, voice input, control panel input, etc.

In some embodiments, a terminal device 2 (such as a mobile terminal, a tablet, a computer, a laptop, etc.) can also be used to control the display device 200 . For example, the display device 200 is controlled using an application program running on the terminal device.

In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the terminal device 2. For example, the display device 200 can directly receive the user's voice command control through a module configured inside the display device 200 to obtain voice commands. , the user's voice command control can also be received through a voice control device provided outside the display device 200 .

In some embodiments, the display device 200 also communicates data with the server 4 . The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 4 can provide various contents and interactions to the display device 200. Server 4 may be a cluster or multiple clusters, and may include one or more types of servers.

FIG. 2 is a configuration block diagram of the control device 100 shown in this application according to some exemplary embodiments. As shown in Figure 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control device 100 can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, thus serving as an interactive mediator between the user and the display device 200 .

FIG. 3 is a hardware configuration block diagram of the display device 200 shown in this application according to some exemplary embodiments.

In some embodiments, the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a processor 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface. At least one.

In some embodiments the processor includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, first to nth interfaces for input/output.

In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, for receiving image signals output from the processor, and displaying video content, image content, and menu control interfaces. Components and user control UI interface.

In some embodiments, the display 260 can be a liquid crystal display, an OLED display, a projection display, or a projection device and a projection screen.

In some embodiments, communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 4 through the communicator 220 .

In some embodiments, the user interface may be used to receive control signals from the control device 100 (such as an infrared remote control, etc.).

In some embodiments, the detector 230 is used to collect signals from the external environment or interactions with the outside. For example, the detector 230 includes a light receiver, a sensor used to collect ambient light intensity; or the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: High Definition Multimedia Interface (HDMI), Analog or Data High Definition Component Input Interface (Component), Composite Video Input Interface (CVBS), USB Input Interface (USB), RGB port and any one or more interfaces. It can also be a composite input/output interface formed by the above-mentioned multiple interfaces.

In some embodiments, the tuner-demodulator 210 receives broadcast television signals through wired or wireless reception methods, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.

In some embodiments, the processor 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the processor 250 is located, such as an external set-top box. wait.

In some embodiments, the processor 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The processor 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on display 260, processor 250 may perform operations related to the object selected by the user command.

In some embodiments, the object may be any of selectable objects, such as a hyperlink, an icon, or other operable control. Operations related to the selected object include: displaying a link to a hyperlinked page, document, image, etc., or executing a program corresponding to the icon.

In some embodiments, the processor includes a central processing unit (CPU), a video processor, Audio processor, Graphics Processing Unit (GPU), RAM (Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first interface to nth interface for input/output, communication bus (Bus) and so on.

The CPU processor is used to execute operating system and application program instructions stored in the memory, and to execute various application programs, data and content according to various interactive instructions received from external inputs, so as to ultimately display and play various audio and video contents. . CPU processor, which can include multiple processors. For example, it includes a main processor and one or more sub-processors.

In some embodiments, the video processor is configured to receive an external video signal and perform decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal. Through processing, the signal displayed or played on the display device 200 can be obtained.

In some embodiments, the audio processor is used to receive external audio signals, perform decompression and decoding according to the standard codec protocol of the input signal, as well as noise reduction, digital-to-analog conversion, and amplification processing to obtain the result. A sound signal played from a speaker.

In some embodiments, the user may input user commands in a graphical user interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

Based on the above display device 200, if the display device 200 cannot recommend recipes based on the ingredients actually stored by the user, the recipes recommended to the user can only be the default recommended recipes, which are inconsistent with the user's actual ingredients and are not intelligent enough.

In order to solve the above problems, some embodiments of the present application provide an electronic device and a data processing method.

The recipe recommendation process provided by some embodiments of the present application will be introduced below with reference to the accompanying drawings.

Figure 4A is one of the schematic flow diagrams of the data processing method shown in this application according to some exemplary embodiments. The electronic device in this application may be a display device, or a device with a food management function such as a food storage device. Data may include data related to recipes, data processing related to ingredient processing, etc. In some embodiments, the present application provides a display device. The display device 200 includes a display 260, a communicator 220, and a processor 250. The processor 250 is communicatively connected to the display 260, and the communicator 220 is used to In communication with an external device, the processor 250 is configured to perform the data processing process in FIG. 4A. Combined with Figure 4A, the data processing process is as follows:

S210, the display device 200 determines the ingredient request information in response to the operation of recipe recommendation, and the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device.

S220: The display device 200 obtains recipes according to the ingredient information.

S230. Control the display to display the recipe.

The display device and the food storage device may be the same device or different devices. If the display device is not an ingredient storage device, such as a TV or other devices that do not store ingredients, it cannot recommend recipes based on the ingredients actually stored by the user. As a result, only default recommendations can be displayed, which seriously deviates from the actual ingredient information. It is worth studying how to display recipe recommendations that match actual ingredients on equipment that does not store ingredients.

In order to solve the above problem, some embodiments of the present application provide a data processing method in which the display device and the food storage device are not the same device.

Figure 4B is the second schematic flowchart of the data processing method shown in this application according to some exemplary embodiments.

If the display device and the food storage device are not the same device, as shown in Figure 4B, perform the following steps:

S310. The display device 200 responds to the operation of recipe recommendation and obtains the local area network address of the ingredient storage device.

Among them, the food storage device refers to a device used to store food, and has a food management module that stores food information. When the user performs operations such as adding, deleting, or modifying ingredients, the operation is performed on the ingredient information stored locally by the ingredient management module. This application does not limit the number of food storage devices. That is, the display device 200 can obtain the LAN address of one food storage device or the LAN addresses of multiple food storage devices.

For example, the display device 200 can recommend recipes for the user. FIG. 5 is a schematic diagram of the display effect of the recipe recommendation interface shown in this application according to some exemplary embodiments. As shown in Figure 5, the interface provides interface choices for several functions such as "Recommended Recipes", "Recipe Classification", "Recipe Collection" and "Food Circle". Users can choose one of the interfaces to view according to their needs. For example, after selecting the "recipe recommendation" function, the display device 200 displays a recipe recommendation list in response to the recipe recommendation operation, and the user can select the recipe he wants to cook on this interface.

For example, the LAN address is the Internet Protocol (IP) address of the device within the LAN. For example, the local area network is a local area network covering a home area.

For example, the ingredient information includes ingredient category, ingredient name, ingredient storage time, ingredient shelf life, etc.

Among them, the shelf life of food ingredients refers to the time that the food ingredients can be stored or preserved, such as 3 days, 24 hours, etc.

Figure 6 is a schematic flow chart of obtaining the LAN address of a device according to some exemplary embodiments of this application. In one example, the process for the processor 250 to obtain the LAN address of the food storage device is as shown in Figure 6:

S311. The display device 200 determines the address request information, which is used to obtain the local area network address of the food storage device.

The processor 250 of the display device 200 determines the LAN address of the display device 200, and then determines the address request information according to the LAN address of the display device 200. The address request information includes the local area network address of the display device 200 and a first information type. The first information type indicates that an online food storage device has been found.

S312. The display device 200 sends the address request information.

Specifically, the display device 200 sends the address request information in the local area network it accesses through the communicator 220 in a multicast or broadcast manner.

S313. The display device 200 receives address response information, which includes the local area network address of the food storage device.

After receiving the address request information, other online devices in the local area network determine address response information based on the address request information, and the other devices send address response information to the display device 200 .

In the above method, the processor 250 sends address request information to devices connected to the same local area network. The address request information includes a first information type. The first information type indicates that the online food storage device is found, so that other devices can be configured according to the first information type. An information type determines whether the device is a food storage device; the address request information also includes the LAN address of the display device 200, which can cause other devices to send the LAN address of the device to them based on the LAN address of the display device 200. Since the display device 200 enables devices connected to the same local area network to receive address request information through multicast or broadcast, the LAN addresses of all food storage devices in the local area network can be accurately and effectively obtained.

In some embodiments, the address request information is transmitted in a data packet in User Datagram Protocol (UDP) format.

In one example, the way for an online device in the local area network to determine and send the address response information includes: after the device accessing the local area network receives the address request information, based on the first information type in the address request information, based on the packet manager ( Package Manager) determines whether the device is a food storage device. If the device is a food storage device, determines the address response information. The address response information includes the LAN address of the device. Then connect the device root of the LAN The address response information is sent to the display device 200 in a unicast manner according to the LAN address of the display device 200 in the address request information, where the address response information is included in a data packet in UDP format and transmitted.

The address response information also includes a second information type, and the second information type indicates that the device sending the address response information is an ingredient storage device with an ingredient management function.

Since the address response information received by the display device 200 after sending the address request information is sent by the food storage device, the device that sends the address response information may have the food management function by default. Therefore, the address response information may not include the above-mentioned second information. type. If the address response information also includes the second information type, it is further ensured that the device sending the address response information is a food storage device with a food management function.

The address response information also includes the login account information of the food storage device. The login account information includes the user ID and may also include family information, where the family information is used to distinguish different families under the same user account. After each device logs in and establishes a communication connection with the server, the server will synchronize its user's login account information to the device.

The home information includes the address of the home where the device is located, or the identification made by the server (or the user) of the home where the device is located.

S320, the display device 200 determines the food material request information, and the food material request information is used to obtain the food material information stored locally by the food material storage device.

Specifically, the display device 200 determines the above food ingredient request information according to the local area network address of the display device. The food material request information includes the local area network address of the display device 200 and a third information type. The third information type is used to represent obtaining the food material information stored locally in the food material storage device.

S330. The display device 200 sends food ingredient request information.

Specifically, the display device 200 sends the food material request information according to the local area network address of the food material storage device.

In one example, after obtaining the address response information sent by the food storage device, the processor 250 determines whether the login account information of the display device 200 and the login account information of the food storage device are the same. If they are the same, then determines whether the login account information of the food storage device is the same. is the food source device, and then sends food request information to the food source device in a unicast manner according to the LAN address of the food source device. If they are different, the food storage device is determined to be a non-food source device, and the local address response information about the device is deleted.

In some embodiments, the login account information includes the user's identification, and the processor 250 determines whether the user identification of the display device 200 is the same as the user identification of the food storage device. If they are the same, the food storage device is determined to be the food source device.

In some embodiments, the login account information includes the user's identification and family information. The processor 250 determines whether the user identification of the display device 200 is the same as the user identification of the food storage device, and determines whether the family information of the display device 200 is the same as that of the food storage device. The household information of the food storage device is the same. If both are the same, the food storage device is determined to be the food source device.

The above method determines whether the food storage device and the display device 200 are devices of the same user by determining whether the user ID of the display device 200 and the user ID of the food storage device are the same. In this way, the user's information can be filtered out from the food storage device. A valid device that provides ingredient information, not another user's device. The accuracy of the filtered devices can be further improved based on whether the two family information are the same. Thus, the food material request information is sent to the food material storage device, and accurate food material information stored in the user's home can be obtained.

In one example, if the display device 200 has an ingredient management function, the local ingredient information on the ingredient management module on the local device is obtained, and the local ingredient information and the ingredient information obtained from other devices are merged and then sent to the server. send. In this method, even if the display device 200 can store food ingredients, by merging the food material information of other devices, The comprehensive recommended recipes obtained will be more comprehensive.

S340: After receiving the ingredient information, the display device 200 obtains the recipe based on the ingredient information.

In one example, after receiving the ingredient request information, the ingredient storage device reads the locally stored ingredient information through the interface of the ingredient management module. Then determine the ingredient information list based on the ingredient information. Then, the ingredient information list is converted into information text in JS object notation (JavaScript Object Notation, JSON) format, and the ingredient information list is sent to the display device 200 according to its local area network address in a unicast manner. The list of ingredient information is shown in Table 1 below:

Table I

As can be seen from Table 1, the storage time of ingredients is determined by the date (year, month, day) and time (hours, minutes, seconds) when the ingredients are stored. The unit of the shelf life of ingredients can be time units such as days, hours, minutes, etc.

In one example, after receiving the ingredient information sent by each ingredient storage device, the display device 200 parses the information text in JSON format and converts it into an ingredient information list of each ingredient storage device. Then obtain all the food material information stored in the current user's home according to each food material information list.

In one example, the display device 200 determines the expiration time of each food item based on the current time in the food material information, the storage time of the food material, and the shelf life of the food material. The expiration time is the time from the current moment to the shelf life date of the food material. Then all the ingredients are sorted according to the expiration time of each ingredient, and the ingredient information of the ingredients that meet the first preset condition is determined, and then the ingredient information of the ingredient that meets the first preset condition is sent to the server. Receive a recipe from the server, where the recipe is determined by the server based on the ingredient information of the ingredients that meet the first preset condition.

In some embodiments, the expiry time = the storage time of the food material + the shelf life of the food material - the current time.

If the expiration time is less than 0, the corresponding ingredient information will be deleted. Then sort the retained ingredients according to the expiration time from small to large. Correspondingly, the priority of the ingredients is from high to low, and each expiration time corresponds to a priority. For example, the priority of the ingredients with the shortest expiration time is the first level, the priority of the ingredients ranked after it is the second level, and so on.

For example, the ingredients that meet the first preset condition are the ingredients from the first to the third level among the sorted ingredients.

In one example, the server calculates the correlation based on the ingredient names in the ingredient information and the side dish information and recipe names in each recipe, calculates the recipe with the highest matching degree, and sends it to the display device 200 .

Using the above method, the display device 200 can obtain the fused food information from multiple devices that store food, and prioritize the food based on the shelf life of each food. After deleting expired ingredients, priority is given to obtaining recommended recipes based on ingredients with shorter expiration dates to avoid expiration of ingredients due to untimely consumption, which enhances the intelligence of the display device.

S350, the processor 250 of the display device 200 controls the display 260 to display the recipe.

The processor 250 controls the display 260 to display the recipe according to the recipe sent by the server. The display effect can be seen in Figure 5.

It can be seen from the above embodiments that since there may be multiple food storage devices in a home local area network, the communication connection relationship between the multiple food storage devices, the display device 200 and the router is as shown in FIG. 7 . Figure 7 is a schematic diagram of the communication connection relationship of devices in a local area network according to some exemplary embodiments of this application. The display device of the present application obtains the LAN addresses of multiple food storage devices (food storage device 1 and food storage device 2 in Figure 7) that are connected to the same local area network as the display device, and can obtain the LAN addresses according to the LAN address of the display device and the multiple food storage devices. The local area network address of each food material storage device enables interaction between the multiple food material storage devices, thereby obtaining food material information of the multiple food material storage devices. display device The device fuses the ingredient information of multiple ingredient storage devices and sends it to the server, so that the server can recommend recipes based on the merged ingredient information of multiple devices in the home local area network, so that the recipe finally obtained by the display device conforms to the actual storage of ingredients. Achieve more intelligent recommendation of recipes to users. In addition, if the display device 200 does not have an ingredient management function, the recipes obtained through the above method avoid the problem that only default recommended recipes can be displayed, which is not practical; if the display device 200 can store ingredients, then by merging other ingredient storage The equipment's ingredient information makes the comprehensive recommended recipes available more comprehensive.

Some embodiments of this application also provide a data processing method, which method includes:

In response to the operation of recipe recommendation, the display device determines the ingredient request information, and the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device;

Obtain recipes based on the ingredient information;

The display device controls its display to display the recipe.

If the display device and the food storage device are not the same device, FIG. 8 is a schematic flowchart of another data processing method shown in this application according to some exemplary embodiments. Referring to Figure 8, the method includes:

S410. In response to the operation of recipe recommendation, the display device 200 obtains the local area network address of the ingredient storage device.

Specifically, in response to the operation of recipe recommendation, the display device 200 obtains the LAN address of an ingredient storage device connected to the same local area network as the display device, where the ingredient storage device includes the first terminal device.

S420, the display device 200 determines the food material request information, and the food material request information is used to obtain the food material information stored locally by the food material storage device.

Specifically, the display device 200 determines the food ingredient request information according to the local area network address of the display device.

S430: The display device 200 sends the food material request information, and the first terminal device receives the food material request information.

Specifically, the display device 200 sends the food ingredient request information to the first terminal device according to the LAN address of the first terminal device.

S440: The first terminal device sends the food material information, and the display device 200 receives the food material information.

Specifically, after receiving the food material request information, the first terminal device determines the locally stored food material information based on the food material management module, and then sends the food material information to the display device. After receiving the ingredient information, the display device 200 obtains the recipe based on the ingredient information.

S450, the display device 200 controls its display 260 to display the recipe.

In one example, the display device 200 determines and sends address request information according to the LAN address of the display device, and the address request information is used to obtain the LAN address of the food storage device. Then, address response information from the first terminal device is received, where the address response information includes the local area network address of the first terminal device.

Ingredient storage equipment can provide users with multiple functions such as intelligent management of ingredients, intelligent storage, recipe recommendations, and multi-functional reminders. Taking the food storage device as a smart refrigerator as an example, the user can control the recipe recommendation interface to be displayed on the display screen of the smart refrigerator, and select any recipe in the recipe recommendation interface so that the display screen displays the details of the recipe, for example , so that the display shows the cooking ingredients, cooking steps and cooking time required for the recipe.

The ingredient storage device can be connected to the Internet, and users can add the ingredients required for the recipe to the shopping cart with one click and purchase the required ingredients. However, this method of purchasing ingredients may lead to repeated purchases. For example, if ingredient A is stored in the ingredient storage device, and the recipe selected by the user also includes ingredient A, one-click purchase of the ingredients in the recipe will result in repeated purchases. Ingredient A causes a waste of ingredients and is not conducive to user experience.

In order to solve the above problem, some embodiments of the present application provide another display device and a data processing method.

If the display device and the food storage device are the same device, for example, the device is a smart refrigerator. Figure 9 shows the root of this application A usage scenario diagram of a smart refrigerator is shown according to some exemplary embodiments. Figure 9 exemplarily shows the operation scenario between the food storage device, the control device and the terminal device. As shown in FIG. 9 , the user can operate the food storage device 3 through the control device 100 , or the user can interact with the food storage device 3 through the terminal device 2 connected to the server 4 to operate the food storage device 3 .

In some embodiments, the control device 100 may be a remote control. The communication between the remote controller and the food storage device 3 includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods. The food storage is controlled through wireless or other wired methods. Device 3. Among them, the wireless mode can be direct connection or indirect connection, and can be routed or not. The user can control the food storage device 3 by inputting user instructions through buttons on the remote control, voice input, control panel input, etc. For example, users can control food storage equipment by inputting corresponding control instructions through the volume up and down keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, power on/off keys, etc. on the remote control. 3 functions.

In some embodiments, terminal devices 2 such as mobile phones, tablets, computers, laptops, and other smart devices can also be used to control the food storage device 3 . The terminal device 2 can realize connection and communication with the food storage device 3 through a network communication protocol to achieve the purpose of one-to-one control operation and data communication.

As also shown in Figure 9, the food storage device 3 and the terminal device 2 also perform data communication with the server 4 through a variety of communication methods. The food storage device 3 and the terminal device 2 can be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN) and other networks. The server 4 can provide various contents and interactions to the food storage device 3 and the terminal device 2 .

In some embodiments, the server 4 may be a cluster or multiple clusters, and may include one or more types of servers. Other network service contents such as popular recipes and cooking services are provided through server 4.

In some embodiments, the food storage device 3 may be a device with intelligent management for storing food, such as a smart refrigerator, a smart freezer, a smart wine cabinet, a smart fruit and vegetable cabinet, or the like. In the specific implementation manner of this application, the technical solution of this application is explained by taking the food storage device as a smart refrigerator as an example. The structure and functions of the smart refrigerator are first described in detail below.

FIG. 10A is a three-dimensional view of a smart refrigerator according to some exemplary embodiments of the present application. The shape of the smart refrigerator provided by the embodiments of the present application is approximately a rectangular parallelepiped. The smart refrigerator is defined by a storage compartment providing limited storage space and a door 1200 (1200A-1200B) provided at the opening of the storage compartment. The storage room is a box with an opening. In the example shown in FIG. 10A , the storage chamber includes a freezing chamber 1100 located below and a refrigerating chamber 1101 located above. The freezing chamber 1100 and the refrigerating chamber 1101 respectively have one or more independent storage spaces, as included in the freezing chamber 1100 Drawer-type compartments, etc., as well as a plurality of storage compartments 1101A-1101B included in the refrigerator compartment 1101, the top lighting is located inside the storage compartment.

In the example shown in Figure 10A, multiple drawer compartments are covered by drawer doors. The refrigerating compartment 1101 is divided into left and right sides, and the left and right sides are respectively covered by doors that are pivotably installed on the box body.

It should be noted that FIG. 10A is an example of an embodiment of the present application, and the smart refrigerator shown in FIG. 10A does not constitute a limitation on the smart refrigerator provided by the present application. For example, in another embodiment of the present application, the smart refrigerator box is divided into left and right sides, the left box is defined as the freezing chamber 1100, and the right box is defined as the refrigerating chamber 1101. The freezing chamber 1100 and the refrigeration chamber are Each chamber 1101 can be covered by a door pivotably mounted on the box. As another example, in another embodiment of the present application, the storage room includes a refrigerating room 1101, a freezing room 1100, and a changing room.

Based on the smart refrigerator provided in the above embodiment, by setting a display outside the smart refrigerator box, the smart refrigerator can have a display function.

Figure 10B is a schematic diagram of the appearance of a smart refrigerator according to some exemplary embodiments of the present application. As shown in Figure 10B, A display is provided on the refrigerator door, and the display is embedded in the door body.

In some embodiments, the refrigerator may also be provided with an ingredient detector. The ingredient detector may be used to detect the type and quantity of ingredients stored in the refrigerator. For example, the ingredient detector may include a camera. The camera is installed in the refrigerated room. The interior image of the refrigerator room is analyzed, and the type and quantity of the inventory ingredients stored in the refrigerator room are obtained. For another example, the ingredient detector can be a tag reader set on the refrigerator door. The tag reader has a built-in user interface. An antenna for reading RFID tags is used to identify RFID tags at close range, thereby recording the type and quantity of inventory ingredients stored in the cold storage room.

In some embodiments, the plane of the display screen is flush with the outer surface of the door.

Figure 11 is a schematic diagram of the hardware configuration of a smart refrigerator according to some exemplary embodiments of the present application. As an example, the smart refrigerator 2000 may include a display 260, a processor 250, multiple antennas 280 for detecting RFID tags, a detector 230, Memory 290 and several user input interfaces. The display 260, the antenna 280, the detector 230, and the memory 290 are coupled with the processor 250 through a communication interface. Among them, the display 260 is used to receive the image signal output by the processor 250, display video content and images and components of the menu control interface, and display a user control UI interface for controlling the smart refrigerator 2000.

The processor 250 may include one or more processing units, such as a system on a chip (SoC), a central processing unit (CPU), a microprocessor (microcontroller, MCU), a storage processor, etc. Among them, different processing units can be independent devices or integrated in one or more processors.

In some embodiments, the processor 250 communicates with the antenna 280 through a serial port.

In some embodiments, the processor 250 includes an RFID module. The RFID module, antenna 280 and RFID tag constitute an RFID reading and writing system. The antenna 280 is used to transmit radio frequency signals between the RFID module and the RFID tag. The RFID module completes the communication through the antenna 280. Read and write operations of RFID tags.

In some embodiments, the RFID module communicates with the antenna via a serial port.

Memory 290 may include one or more storage units, for example, may include volatile memory (volatile memory), such as: dynamic random access memory (dynamic random access memory, DRAM), static random access memory (static random access memory) , SRAM), etc.; it can also include non-volatile memory (NVM), such as read-only memory (ROM), flash memory (flash memory), etc. Different storage units can be independent devices, or they can be integrated or packaged in one or more processors or communication interfaces and become part of the processor or communication interface.

The memory 290 stores program instructions and application programs, such as voice applications. The processor 250 can call program instructions in the memory 290 or run an application program to cause the smart refrigerator to perform related methods, such as the food label scanning method provided in the embodiment of the present application.

The detector 230, which at least includes a sound collector such as a microphone, may be used to receive the user's voice. By way of example, the voice signal includes a user's control instruction for controlling the smart refrigerator 2000 . The detector 230 may also include a door switch state sensor, such as a magnetic sensitive switch or a mechanical switch, for detecting the switch signal of each door. When the switch state of the door is recorded according to the detected switch signal, a switch is sent. Status information to processor 250. For example, when the detector detects an opening signal or a closing signal of any door, the latest switch status information is sent to the processor 250 .

The user input interface includes at least one of a microphone, a touch pad, a sensor, a button, and other input interfaces. For example, the user can realize the user command input function through actions such as voice, touch, gesture, and pressing. The input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the processor 250 .

The communicator 220 is used to communicate with the server or the terminal device 2 connected to the server.

In some embodiments, the processor 250 may include a voice recognition module, and the voice recognition module may further include a voice parsing unit and a voice instruction database, so that the smart refrigerator can independently complete voice recognition of the voice data input by the user, and convert the recognized voice data into a voice recognition module. The process of matching voice content with voice commands in the voice command database.

This application does not limit the number of antennas 280. For example, the antenna 280 may include an antenna provided in each storage room and an antenna provided inside the tag reader, wherein the antenna provided in each storage room is mainly used to scan the RFID tags in each storage room to read the RFID tags. The antenna set inside the tag reader is mainly used to scan the RFID tag on the tag reader to read the tag information of the RFID tag.

In some embodiments, the power of antennas provided in different storage rooms may be different. The power of the antennas in each storage room is sufficient to ensure that the antenna can recognize the food contained in its own room, thereby avoiding an increase in false recognition rates when the power is too high, and when the power is too low, the food in its own room cannot be recognized. In a specific implementation, the power of the antenna can be determined in advance according to the space size of each storage room, and the power of each antenna can be set in the smart refrigerator. The larger the space, the greater the power.

In some embodiments, the antenna disposed under the tag reader is called a first antenna, and the antenna disposed in the storage room is called a second antenna.

Based on the smart refrigerator provided by the embodiment of the present application, RFID tags can be used to identify the ingredients in the storage room. There is a corresponding relationship between the tag information of the RFID tag (such as the tag identification) and the ingredient information of the identified ingredients, thereby realizing the RFID tag Virtual association with ingredient information. In practical applications, ingredients with RFID tags are stored in a smart refrigerator, and the RFID tag in the storage room is detected through the second antenna to obtain the tag information. The ingredients identified by the tag are determined based on the relationship between the tag information and the ingredient information. .

In some embodiments, the tag information includes tag encoding, and a specific code segment in the tag encoding is the tag identification. Establishing the corresponding relationship between the identification information of the RFID tag and the food material information can realize the virtual association between the RFID tag and the food material. Furthermore, after obtaining the tag identification of the RFID tag in the storage room, the food ingredients corresponding to the RFID tag can be determined based on the tag identification and the pre-established correspondence relationship.

In some embodiments, the processor 250 implements the food material management function by running a food material management application. The application interface provided by the food material management application includes: a food material management interface that can be used as the main interface of the application, and an API for establishing an association between RFID tags and food material information. Tag editing interface, recipe display interface for displaying recommended recipe information, etc.

In some embodiments, the processor 250 starts the food management application in response to booting or a user input command to start the food management application. After the food management application is launched, the user can enter label editing instructions in the food management application. In response to the tag editing instruction, the food management application scans the RFID tag placed by the user on the tag reader through the first antenna to obtain the tag information of the RFID tag, such as "A", and displays the tag editing interface. Users can enter ingredient information in the label editing interface to associate with "A". The food material management application receives the food material information input by the user and establishes an association between the food material information and "A". When the food material management application detects the RFID tag "A" in the storage room through the second antenna, it can determine the real food materials in the storage room based on the food material information associated with "A", thereby realizing intelligent management of food materials. It should be understood that when the food material management application detects that there is an RFID tag "A" in the storage room through the second antenna, the food material associated with "A" is the existing food material in the storage room.

In some embodiments, the ingredient information includes one or more of ingredient ID, ingredient name, storage location identification, ingredient quantity, ingredient shelf life, starting time, etc. The storage room where the ingredient is stored can be determined based on the storage location identification. For example, if the storage location identifier contained in the ingredient information "apple" is "1", then it is determined that "apple" is stored in the refrigerator compartment. If the storage location identifier included in the ingredient information "apple" is "2", then it is determined that "apple" is stored in the refrigerator. Apples” stored in the freezer. The freshness of the ingredients can be determined based on the current time, the shelf life and the starting time of the ingredients. Among them, at the beginning The time can be the real production date of the ingredients input by the user, such as the production date of bread on May 1, 2021, or it can be the time when the ingredients were put into the storage room.

In some embodiments, the food material information corresponding to the existing food materials in the storage room is stored in a local food material information collection. The existing food ingredients refer to the food ingredients currently stored in the smart refrigerator.

In other embodiments, the above-mentioned local food material information collection may also store food material information corresponding to historical food materials. The historical ingredients refer to ingredients that were stored in the smart refrigerator in the past and have been removed from the smart refrigerator at present. During specific implementation, existing food materials and historical food materials can be distinguished by storage status marks. For example, the food material information of historical food materials is marked as removed state, and the food material information of existing food materials is marked as put in state.

In other embodiments, the ingredient information of existing ingredients and the ingredient information of historical ingredients are stored in different ingredient information sets.

In some embodiments, after the food material management application is started, the food material information of existing food materials is read from the local food material information collection, for example, the food material information whose storage status is the put-in state is read. Then the food material management interface is displayed according to the food material information of the existing food materials. The food material management interface includes food material controls drawn according to the food material information, so that all the existing food materials in the smart refrigerator are displayed in the form of icons, pictures and texts. In addition, various functional controls, such as RFID tag editing controls, ingredient adding controls, recipe recommendation controls, etc., can also be displayed in the food material management interface for user operations to trigger the processor 250 to implement corresponding functions.

In some embodiments, the smart refrigerator may also include an ingredient detector and a communicator. The ingredient detector may be used to collect interior images of the smart refrigerator, and the communicator may be used to establish a connection with the server to implement information interaction with the server. The smart refrigerator can obtain the image information of the ingredients inside the refrigerator through the ingredient detector, and send the image information to the server, so that the server can identify the ingredients stored inside the smart refrigerator.

In some embodiments, the processor of the smart refrigerator can control the automatic identification of ingredients inside the refrigerator. For example, the processor can control the automatic identification of ingredients in the storage room every preset time period, or can control the automatic identification of ingredients in the storage room when the refrigerator door is detected. Controls the identification of ingredients inside the refrigerator when it is turned on or off. The processor can also identify the ingredients in the storage room after receiving a control instruction input by the user to identify the ingredients in stock. For example, the user interface displayed on the display of the smart refrigerator displays a message for identifying the ingredients stored in the smart refrigerator. Recognized related controls, the user clicks on the control processor to perform the operation of identifying the internal ingredients.

In some embodiments, when the processor controls the identification of food materials in the storage room, the food material detector may control the collection of interior images of the smart refrigerator, where the interior images include images of food materials stored inside the smart refrigerator. Among them, the food detector can include cameras, and the number of cameras can be multiple. The multiple cameras can be dispersedly distributed inside the refrigerator to ensure that interior images of every corner inside the smart refrigerator can be collected.

Figure 12 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments. As shown in Figure 12, in S1401, the processor can control the camera to obtain the interior image of the storage room, and in S1402 In S1403, the server sends an ingredient identification request to the server, and the ingredient identification request includes the interior image. In S1403, after receiving the ingredient identification request sent by the smart refrigerator, the server can identify the stock ingredient image on the interior image to Obtain the inventory ingredient name and inventory ingredient quantity corresponding to each ingredient image on the interior image. In S1404, the server can generate an inventory ingredient set based on the recognized inventory ingredient name and the inventory ingredient quantity corresponding to each inventory ingredient name, and store the inventory The food material set is sent to the processor. In S1405, the processor responds to the received stock food material set to complete the operation of identifying the internally stored food materials.

In some embodiments, in order to improve the accuracy of processor-controlled identification of ingredients in the storage room, the ingredient detector may also include a weight measuring device for detecting ingredients at a preset position in the smart refrigerator to obtain the preset position in the refrigerator. Bit The weight of the food you set. Among them, the number of weight measuring devices can also be multiple, respectively distributed at specific positions inside the refrigerator. For example, a smart refrigerator can be equipped with a fresh-keeping bin, and a weight measurer can be installed at the bottom of the fresh-keeping bin. The inside of the fresh-keeping bin can be used for Store food such as meat that cannot be accurately measured in quantity. After the processor controls the weight measurer to detect the weight of the food at the preset position, the interior image collected by the camera and the weight of the food can be sent to the server through the server. The server can identify the interior image based on the weight of the food and can update the image. In order to accurately obtain the name and quantity of the ingredients corresponding to each ingredient image in the interior image, for example, it can be recognized that the interior image includes "ingredient 1/600g", "ingredient 2/200g" and "ingredient 3/1kg", etc. The names of the ingredients and the exact quantity of ingredients corresponding to each ingredient name. A set of inventory ingredients can be generated based on the recognized ingredient names and the number of ingredients corresponding to each ingredient name, and the set of inventory ingredients is sent to the processor. The processor receives the set of inventory ingredients to complete the identification of internally stored ingredients. operate.

In some embodiments, the processor may control, based on the name of each inventory ingredient in the inventory ingredient collection, to display an ingredient control corresponding to the name of each inventory ingredient in the user interface of the display. The ingredient control may be presented in the style of an inventory ingredient icon, so as to The user interface shown in Figure 13 is presented. Figure 13 is a schematic diagram of a food material management interface shown in this application according to some exemplary embodiments. It is specifically an exemplary food material management interface. The food material management interface can display Ingredient controls corresponding to the inventory ingredients stored in the storage room. The storage room may include a refrigerator room 501 and a freezer room 502, and the inventory ingredient icons include but are not limited to corresponding inventory ingredient pictures, inventory ingredient names, inventory ingredient quantity, and inventory ingredient freshness indicators, etc. The picture of the stock ingredients may be a pictographic picture of the stock ingredients, and the freshness mark of the stock ingredients is used to show any one or more of the time when the stock ingredients were put in, the remaining time until expiration, and the expiration time. It should be understood that the inventory ingredient pictures, inventory ingredient names, inventory ingredient quantities, and inventory ingredient freshness indicators may be part of the inventory ingredient icon, that is, included in the inventory ingredient icon.

In some embodiments, every preset time period, the refrigerator processor can control the calculation of the freshness of the stored ingredients, and each time the processor detects an action of opening or closing the door, it will trigger a check of the stored ingredients in the storage room. The ingredients are identified to identify whether there are newly stored ingredients in stock. If there are newly stored ingredients in inventory, the storage time and temperature of the storage location are recorded, and the inventory ingredients of the inventory ingredients are sent to the server. name and the temperature at the storage location. After the server receives the name of the inventory ingredient and the temperature at its storage location, it can analyze the shelf life of the inventory ingredient corresponding to the name of the inventory ingredient based on big data, and send the shelf life to the processor. .

When the processor identifies the ingredients inside the refrigerator, it can further filter the set of inventory ingredients returned by the server. In some embodiments, the processor can calculate the freshness of each inventory ingredient based on the storage time, shelf life and current time of each inventory ingredient. The shorter the storage time of the inventory ingredient in the refrigerator, the fresher the inventory ingredient. The higher the value, the longer the storage time of the inventory ingredients in the refrigerator exceeds the shelf life, the lower the freshness. When the freshness of the inventory ingredients is lower than the preset threshold, it is determined that the inventory ingredients are seriously expired, and the inventory ingredients can be removed. The corresponding inventory ingredient name and inventory ingredient quantity are deleted from the inventory ingredient collection, and the information shown in Figure 14 is displayed in the ingredient management interface to remind the user that the inventory ingredient has expired. Figure 14 shows some exemplary examples of this application. The embodiment shows a schematic diagram of another food material management interface.

Figure 15 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments. In some embodiments, as shown in Figure 15, the user can select any ingredient control in the user management interface of the display. In S1701, the intelligent processor sends a recipe in response to the user's selection operation on a specific ingredient control. The recommendation request is sent to the server, and the recipe recommendation request includes the name of the stock ingredients and the quantity of the stock ingredients for the food control. In S1702, after the server receives the name of the stock ingredients and the quantity of the stock ingredients, it obtains the information related to the stock ingredients. Several recipes that match the names of the inventory ingredients and the quantities of the inventory ingredients, and generate a recipe recommendation column in S1703 Table. In S1704, the server sends the recipe recommendation list to the processor. In S1705, after the processor responds to receiving the recipe recommendation list returned by the server, in S1706, the intelligent display shown in Figure 16 can be triggered. Side dish interface. Figure 16 is a schematic diagram of an intelligent side dish interface shown in this application according to some exemplary embodiments. The intelligent side dish interface includes an inventory area 801, a side dish area 802, and a recipe recommendation area 803. The inventory area 801 at least displays the ingredient controls corresponding to all the inventory ingredients stored in the refrigerator, and the side dish area 802 displays the ingredients selected by the user. The ingredient control corresponding to the inventory ingredient, the recipe recommendation area 803 displays a recipe recommendation list returned by the server for the ingredient control selected by the user.

The user interface of the display shown in Figure 16 displays ingredient controls such as "Ingredients 2", "Ingredients 3", and "Ingredients 4". The user selects the ingredient controls corresponding to "Ingredients 2", and the processor responds to the user's Operation, control the ingredient control corresponding to "ingredient 2" to be displayed in the side dish area 802, and send a recipe recommendation request to the server. The recipe recommendation request includes the information of "ingredient 2+600g". After the server receives the information, it can Obtain several recipes made using "Ingredients 2" and generate a recipe recommendation list. Recipes in which the quantity of "Ingredients 2" is less than or equal to 600g in the recipe recommendation list can be recorded in front of the recipe recommendation list. Apply "Ingredients 2" 2" Recipes with the quantity of ingredients greater than 600g can be recorded behind the recipe recommendation list. The server sends the recipe recommendation list to the processor. In response to receiving the recipe recommendation list, the processor can trigger as shown in Figure 16 An intelligent side dish interface. The side dish area 802 in the smart side dish interface can display recipe icons corresponding to each recipe in the recipe recommendation list. The recipe icons include but are not limited to recipe pictures, recipe names, etc. corresponding to the recipes. , it should be understood that the recipe picture, recipe name, etc. may be part of the recipe icon, that is, included in the recipe icon.

In some embodiments, the user can select two or more food ingredient controls at the same time. For example, the user can select both the ingredient controls corresponding to "Ingredients 2" and "Ingredients 3", and the processor can control The ingredient controls corresponding to "Ingredients 2" and "Ingredients 3" are displayed in the side dish area 802, and a recipe recommendation request is sent to the server. The recipe recommendation request includes the information of "Ingredients 2+600g" and "Ingredients 3+200g", and the server receives After obtaining the above information, you can obtain several recipes made using "ingredient 2" and "ingredient 3", and generate a recipe recommendation list, in which the quantity of "ingredient 2" in the recipe recommendation list is less than or equal to 600g and the application Recipes with "Ingredients 3" ingredients less than or equal to 200g can be recorded at the front of the recipe recommendation list. Recipes with "Ingredients 2" ingredients greater than 600g and "Ingredients 3" ingredients greater than 200g can be recorded in the recipe list. After the recommendation list, the server sends the recipe recommendation list to the processor. In response to receiving the recipe recommendation list, the processor can trigger the display of an intelligent side dish interface including the corresponding recipe recommendation list.

In some embodiments, the user can select any recipe icon in the recipe recommendation list, and the processor responds to the user's operation by sending a recipe acquisition request to the server, where the recipe acquisition request includes the identification of the recipe icon selected by the user. After the server receives the recipe acquisition request, it can match the corresponding recipe information according to the identification of the recipe icon. The recipe information at least includes a set of recipe ingredients required to make the recipe, and the set of recipe ingredients includes recipe ingredients. The name and the number of ingredients for the recipe. In addition, the recipe information may also include a picture of the recipe, the steps for making the recipe, etc., which are not limited by this application.

In some embodiments, after the server matches the recipe information corresponding to the identification of the received recipe, it can send the recipe information to the smart refrigerator. In response to receiving the recipe information, the refrigerator processor can trigger the display to display the recipe details. Interface, wherein the recipe details interface at least includes the recipe ingredient controls required for making the recipe. The recipe ingredient controls can be presented in the style of recipe ingredient icons. The recipe ingredient icons include but are not limited to corresponding recipe ingredient pictures, recipes Ingredient names, recipe ingredient quantities, etc. It should be understood that the recipe ingredient pictures, recipe ingredient names, recipe ingredient quantities, etc. may be part of the recipe ingredient icon, that is, included in the recipe ingredient icon.

In some embodiments, after the smart refrigerator receives the recipe information sent by the server, the refrigerator processor can compare the name of each recipe ingredient in the recipe ingredient set with the name of the inventory ingredient in the inventory ingredient set. If there is a name in the inventory ingredient set that matches The names of inventory ingredients with the same names as the recipe ingredients indicate that the ingredient is stored in the refrigerator. The quantity of the ingredient's recipe ingredients and the quantity of the ingredient in stock are further compared to determine whether the quantity of the ingredient stored in the refrigerator meets the needs of making the recipe. If the quantity of the ingredient in stock is greater than the quantity of the recipe ingredient, an inventory mark is added to the name of the recipe ingredient corresponding to the ingredient. After comparing the recipe ingredient set and the inventory ingredient set, the recipe details interface can be triggered. In the recipe details interface, the item being displayed is The status of the recipe ingredient control corresponding to the name of the recipe ingredient with the added inventory mark changes to remind the user that the recipe ingredient is stored in sufficient quantity in the refrigerator to meet the needs of making the recipe. For example, after comparing the recipe ingredient collection and the inventory ingredient collection and adding the refrigerator inventory identification to the recipe ingredient names in the recipe ingredient collection, the user interface can be refreshed to display the recipe details interface as shown in Figure 17 in the user interface, Figure 17 17 is a schematic diagram of a recipe details interface shown in this application according to some exemplary embodiments. The recipe details interface displays the recipe ingredient controls marked by the inventory icon 900 and the recipe ingredient controls not marked by the inventory icon 900 .

In some embodiments, the recipe details interface may also include a purchasing control 910. Figure 18 is a schematic flowchart of generating a purchasing list according to some exemplary embodiments of this application. As shown in Figure 18, in S2001, the processor may respond to the user's selection operation on the purchasing control 910, and in S2002, control the comparison of the recipe ingredient set and the inventory ingredient set. If there is a recipe ingredient with the same name as the recipe ingredient in the inventory ingredient set, The name of the inventory ingredient. In S2003, the processor controls whether the quantity of the inventory ingredient is greater than the quantity of the recipe ingredient. If not, in S2004, the difference between the recipe ingredient and the inventory ingredient is calculated, and in S2005, according to the quantity of the recipe ingredient and The quantity difference of the quantity of ingredients in stock and the names of recipe ingredients generate the first list of information.

If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, in S2006, the processor may generate second list information based on the recipe ingredient name and the recipe ingredient quantity.

For example, the stock ingredient set includes 1/100g of ingredients, 2/80g of ingredients, and 3/20g of ingredients, and the recipe ingredient set includes 1/100g, 2/500g of ingredients, 3/10g of ingredients, 9/50g of ingredients, and 14/1kg of ingredients. and 15/200g of ingredients. By comparing the stock ingredients collection and the recipe ingredient collection, the first list information and the second purchase list can be generated. The first purchase list includes 2/420g of ingredients, and the second purchase list includes 9/50g of ingredients. Ingredient 14/1kg and ingredient 15/200g, and since the inventory quantities of ingredient 1 and ingredient 3 are respectively greater than the recipe quantities of ingredient 1 and ingredient 3, ingredient 1 and ingredient 3 do not need to be recorded in any purchase list.

In some embodiments, after the processor controls to generate the first list information and the second list information, in S2007 and S2008, the purchase list interface can be triggered to be displayed based on the first list information and the second list information. Figure 19 shows this The application shows a schematic diagram of a purchase list interface according to some exemplary embodiments. The first purchase list corresponding to the first list information and the second purchase list corresponding to the second list information are displayed on the purchase list page as shown in FIG. 19 .

In some embodiments, the recipe acquisition request sent by the smart refrigerator to the server may also include the identification of the recipe icon selected by the user and the set of inventory ingredients. After the server receives the recipe acquisition request, it may match the identification of the recipe icon according to the identification of the recipe icon. Corresponding recipe information, the recipe information at least includes a set of recipe ingredients required to make the recipe. The set of recipe ingredients includes the name of the recipe ingredients and the quantity of the recipe ingredients. The server can compare the set of recipe ingredients and the set of inventory ingredients. If the set of inventory ingredients There is an inventory ingredient name that is the same as the recipe ingredient name in , and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient. The first list of information can be generated based on the quantity difference between the quantity of the recipe ingredient and the quantity of the inventory ingredient and the name of the recipe ingredient. If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient collection, the second list of information can be generated based on the recipe ingredient name and the recipe ingredient quantity.

In some embodiments, the server may send the recipe information, the first list information, and the second list information to the smart refrigerator. In response to receiving the recipe information, the first list information, and the second list information, the refrigerator processor triggers Display the recipe details interface and/or the purchase list interface. The recipe details interface at least includes the recipe ingredient controls corresponding to the recipe ingredients required when making the recipe. The purchase list interface at least includes the first purchase list corresponding to the first list information and The second purchase list corresponding to the second list information.

In some embodiments, the purchase list interface also includes a shopping cart control 111. In response to the user's selection operation on the shopping cart control 111, the processor may send a purchase request to the server, where the purchase request includes the The first list information corresponding to the first purchase list and the second list information corresponding to the second purchase list, the purchase request is used to request the server to return a purchase recommendation list, the purchase recommendation list at least includes information for the third purchase list. A list of information and a purchase link of the second list of information. After receiving the purchase recommendation list returned by the server, the smart refrigerator can control the display of the purchase recommendation list interface as shown in Figure 20 in the user interface of the display. Figure 20 is This application shows a schematic diagram of a purchasing recommendation list interface according to some exemplary embodiments. The purchase recommendation list interface may include the name of the ingredients, the quantity of the ingredients, the purchase link, the purchase price, etc. on the displayed purchase list.

In some embodiments, after the processor controls the generation of the first list information and the second list information, the first list information and the second list information can be merged to generate the third list information, and trigger the trigger based on the third list information. The purchase list interface is displayed. Figure 21 is a schematic diagram of another purchase list interface shown in this application according to some exemplary embodiments. The third purchase list corresponding to the third list information is displayed in the purchase list interface as shown in FIG. 21 .

In some embodiments, in response to the user's selection operation on the purchasing control 910, the processor controls the comparison of the recipe ingredient set and the inventory ingredient set. When there is an inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, and the recipe ingredient When the quantity is greater than the quantity of ingredients in stock, the recipe ingredient controls corresponding to the selected recipe ingredients can be displayed in the recipe details interface.

Wherein, when there is an inventory ingredient with the same name as the recipe ingredient in the inventory ingredient set, and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient, the processor can control to calculate the quantity difference between the quantity of the recipe ingredient and the quantity of the inventory ingredient, and The selected recipe ingredient control displayed in the recipe details interface at least includes the name of the recipe ingredient and the difference value.

In some embodiments, when there is no inventory ingredient with the same name as the recipe ingredient in the inventory ingredient collection, the recipe ingredient control corresponding to the selected recipe ingredient is still displayed in the recipe details interface. , wherein the recipe ingredient control at least includes the name of the recipe ingredient and the quantity of the recipe ingredient.

In some embodiments, when there is an inventory ingredient with the same name as the recipe ingredient in the inventory ingredient set, and the number of inventory ingredients is greater than the number of recipe ingredients, the unselected ingredient can be displayed in the recipe details interface. Recipe ingredient controls corresponding to recipe ingredients.

In some embodiments, the user can perform a selection operation on the recipe ingredient control shown in Figure 17. In response to the user's operation, the processor generates and displays the inventory identifier if it detects that the recipe ingredient name included in the recipe ingredient control is marked with an inventory identifier. Reminder interface to remind the user that the inventory of the ingredient is sufficient. If it is detected that the name of the recipe ingredient included in the recipe ingredient control is not marked with an inventory identifier, the recipe ingredient control can be directly controlled to be in a selected state.

In some embodiments, the user selects the shopping cart control in the recipe details interface. In response to the user's operation, the processor can generate a list of ingredients to be purchased based on the recipe ingredient control in the selected state. The list information of the ingredients includes the name of the recipe ingredient corresponding to the selected recipe ingredient control and the quantity of the ingredient that needs to be purchased corresponding to the name of the recipe ingredient. and sends a purchase request to the server, the purchase request including the list information of the ingredients to be purchased, the purchase request is used to request the server to return a purchase recommendation list, the The purchase recommendation list at least includes a purchase link for the list information of the ingredients to be purchased. After receiving the purchase recommendation list returned by the server, the processor can control the display of the purchase recommendation list interface as shown in Figure 20 in the user interface of the display.

In some embodiments, the recipe details interface may also include positioning controls 920 corresponding to each recipe ingredient control. Figure 22 is a schematic diagram of the interaction between a smart refrigerator and a server according to some exemplary embodiments of this application. As shown in Figure 22, after the user selects any positioning control 920, in S2401, the processor responds to the user's operation and sends a positioning request to the server. The positioning request includes the name of the inventory ingredients and the information collected by the ingredient detector. Interior image, the positioning request is used to request the server to mark the position of the stock ingredient image in the interior image, and return the marked interior image. In S2402, the processor responds to receiving the marked interior image returned by the server. The marked interior image may be displayed in a user interface of the display. For example, after the user selects the positioning control bound to ingredient 1 in the recipe details interface, the processor responds to the user's operation and sends a positioning request to the server. The positioning request includes the ingredient name and ingredient detection of ingredient 1. The interior image collected by the processor. After receiving the positioning request, the server can mark the position of the image of ingredient 1 in the interior image and return the marked interior image. The processor responds to the marked position returned by the server. The interior image may be displayed in the user interface of the display after being marked as shown in Figure 23. Figure 23 is a schematic diagram of the interior image according to some embodiments. A detection frame 151 is displayed in the interior image, and the detection frame 151 is used to indicate the location of the food material 1 .

In some embodiments, the smart refrigerator can be connected to other terminal devices through the server. The terminal device can be a mobile phone, a tablet, a wearable device, or any other device with a display function. The processor of the smart refrigerator can control the storage of ingredients. The collection, list information corresponding to the purchase list, etc. are uploaded to the server and forwarded to the terminal device through the server. For example, after the smart refrigerator receives a sharing instruction input by the user to share the purchase list, the refrigerator processor responds to the sharing instruction. , can trigger the display of a user list on the user interface of the display. The user list includes at least one device identification of a terminal device connected to the server. The user performs a selection operation on the device identification in the user list, and the processor responds to the For the selection operation of the device identifier, a synchronization instruction may be sent to the server. The synchronization instruction includes the list information corresponding to the device identifier and the purchase list. The synchronization instruction is used to instruct the server to select the device identifier based on the device identifier. The list information corresponding to the purchase list is sent to the terminal device, so that the purchase list can be displayed on the terminal device.

According to the above embodiments, embodiments of the present application also provide a terminal device, including a display, a communicator, and a processor, wherein the display can display a user interface; the communicator can establish a communication connection with the server, so that the terminal device can communicate with the server through the server. Information interaction is performed with the smart refrigerator connected to the server; the processor is used to execute corresponding control programs.

Referring to Figure 24, Figure 24 is a schematic diagram of the interaction between a terminal device, a smart refrigerator and a server according to some exemplary embodiments of this application. The terminal device may be installed with an application program associated with the above-mentioned smart refrigerator. In S2601, after the user inputs a control instruction to the terminal device to open the application program, in response to the instruction input by the user, the application program is run and can be sent to the server. Send a control instruction for instructing to obtain a set of stock ingredients of the smart refrigerator. The control instruction is used to cause the server to send a request for obtaining a set of stock ingredients to the smart refrigerator. In S2602, the smart refrigerator agrees to the set of stock ingredients. After the request, the set of inventory ingredients can be sent to the server, where the set of inventory ingredients at least includes the name and quantity of the inventory ingredients corresponding to the inventory ingredients stored in the smart refrigerator; in S2603, the terminal device responds to the received The set of stock ingredients returned by the server can trigger the display of a smart side dish interface in the user interface. The smart side dish interface displays the stock ingredients generated based on the set of stock ingredients. controls.

The user performs a selection operation on any inventory ingredient control. In response to the user's operation, the processor can send a recipe recommendation request to the server. The recipe recommendation request includes the name and quantity of the inventory ingredients corresponding to the inventory ingredient control selected by the user. The server receives After the names of the stock ingredients and the quantity of the stock ingredients are obtained, several recipes matching the names of the stock ingredients and the quantity of the stock ingredients are obtained, a recipe recommendation list is generated, and the recipe recommendation list is sent to the terminal device, and the terminal In response to receiving the recipe recommendation list returned by the server, the device may trigger display of the recipe recommendation list, where the recipe recommendation list includes at least one recipe icon for the name of the stock ingredient and the quantity of the stock ingredient.

In some embodiments, in response to the user's selection operation on any recipe icon in the recipe recommendation list, the terminal device may send a recipe acquisition request to the server, where the recipe acquisition request includes the identification of the recipe icon selected by the user, and the server receives the After the recipe acquisition request is made, the corresponding recipe information can be matched according to the identification of the recipe icon, and the recipe information is sent to the processor, where the recipe information at least includes a set of recipe ingredients required to make the recipe, so The set of recipe ingredients includes the name of the recipe ingredients and the quantity of the recipe ingredients. In addition, the recipe information may also include recipe pictures, steps for making the recipe, etc., which are not limited by this application.

In some embodiments, after receiving the recipe information sent by the server, the terminal device can compare the name of each recipe ingredient in the recipe ingredient set with the name of the inventory ingredient in the inventory ingredient set. If there is a name in the inventory ingredient set that matches the name of the recipe ingredient The same name of the ingredient in stock means that the ingredient is stored in the refrigerator, and the quantity of the ingredient in the recipe and the quantity of the ingredient in stock are further compared to determine whether the quantity of the ingredient stored in the refrigerator meets the needs of making the recipe. If the ingredient The number of ingredients in the recipe is greater than the number of ingredients in stock, then the inventory identification is added to the name of the recipe ingredient corresponding to the ingredient. After comparing the recipe ingredient collection and the inventory ingredient collection, the recipe details interface can be triggered. In the recipe details interface, the inventory identification is added The status of the recipe ingredient control corresponding to the recipe ingredient name changes. For example, a stock icon is displayed next to the recipe ingredient control to remind the user that the recipe ingredients are stored in sufficient quantities in the refrigerator to meet the needs of making the recipe. For example, after comparing the recipe ingredient collection and the inventory ingredient collection and adding the refrigerator inventory identification to the recipe ingredient names in the recipe ingredient collection, the user interface can be refreshed to display the recipe details interface in the user interface, and the recipe details interface displays Recipe ingredient controls marked by the inventory icon and recipe ingredient controls not marked by the inventory icon.

In some embodiments, the recipe details interface may also include a purchasing control. In response to the user's selection operation of the purchasing control, the terminal device may compare the recipe ingredient collection and the inventory ingredient collection. If the inventory ingredient set contains the same name as the recipe ingredient, For the same inventory ingredient names, and the quantity of the recipe ingredients is greater than the quantity of the inventory ingredients, the first list of information can be generated based on the quantity difference between the quantity of the recipe ingredients and the quantity of the inventory ingredients and the names of the recipe ingredients. If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient collection, the second list of information can be generated based on the recipe ingredient name and the recipe ingredient quantity.

In some embodiments, after the terminal device controls the generation of the first list information and the second list information, the display of the purchase list interface can be triggered based on the first list information and the second list information. The first list information corresponding to the first list information can trigger the display of the purchase list interface. Both the purchase list and the second purchase list corresponding to the second list information are displayed in the purchase list interface.

In some embodiments, the recipe acquisition request sent by the terminal device to the server may also include the identifier of the recipe icon selected by the user. After the server receives the recipe acquisition request, the server may match the corresponding recipe information based on the identifier of the recipe icon. , the recipe information at least includes a set of recipe ingredients required to make the recipe, and the set of recipe ingredients includes the name of the recipe ingredients and the quantity of the recipe ingredients. After that, the server sends a stock ingredient acquisition request to the smart refrigerator to obtain the inventory ingredients stored in the smart refrigerator. Inventory ingredient collection. After the server receives the inventory ingredient collection sent by the smart refrigerator, You can compare the recipe ingredient collection and the inventory ingredient collection. If there is an inventory ingredient with the same name as the recipe ingredient in the inventory ingredient set, and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient, the difference in quantity between the quantity of the recipe ingredient and the quantity of the inventory ingredient and the quantity of the recipe ingredient will be compared. The name can generate the first list of information. If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient collection, the second list of information can be generated based on the recipe ingredient name and the recipe ingredient quantity.

In some embodiments, the server may send the recipe information, the first list information, and the second list information to the terminal device, and the processor of the terminal device responds to receiving the recipe information, the first list information, and the second list information. , triggering the display of the recipe details interface and/or the purchase list interface. The recipe details interface at least includes the recipe ingredient controls corresponding to the recipe ingredients required when making the recipe. The purchase list interface at least includes the first purchase corresponding to the first list information. list and the second purchase list corresponding to the information in the second list.

In some embodiments, the purchase list interface further includes a shopping cart control. In response to the user's selection operation on the shopping cart control, the terminal device may send a purchase request to the server, where the purchase request includes the first List information and the second list information, the purchase request is used to request the server to return a purchase recommendation list, the purchase recommendation list at least includes items to be purchased in the first list information and the second list information. For the purchase link of food ingredients, after the terminal device receives the purchase recommendation list returned by the server, it can control the display of the purchase recommendation list interface in the user interface. The purchase recommendation list interface can include the first list information and the second list information corresponding to the to-be-received list. The name of the ingredients, the quantity of the ingredients, the purchase link and the purchase price of the purchased ingredients.

The above UI takes smart refrigerators and terminal equipment as examples respectively, and the interactive content takes smart refrigerators, servers, and smart terminals as examples. The UI of other categories of smart refrigerators and terminal equipment when generating purchase lists is basically similar to the above UI, and will not be repeated here. List one. The UI interface provided in this application is only an example, and the actual application and design shall prevail.

According to the above embodiments, embodiments of the present application also provide a method for generating a purchase list, which can be executed on the smart refrigerator side, and the execution subject of the method is a processor in the smart refrigerator. Methods include:

S100: Receive recipe selection instructions input by the user.

In some embodiments, before receiving the recipe selection instruction input by the user, the method further includes receiving a control instruction input by the user indicating the identification of inventory ingredients; in response to the control instruction, sending an ingredient identification request to the server, the ingredient identification The request includes the interior image, and the ingredient identification request is used to request the server to identify the interior image and return the inventory ingredient set; receive the inventory ingredient set returned by the server; and according to the inventory ingredient set , displaying an ingredient control for the name of the inventory ingredient and the quantity of the inventory ingredient on the user interface of the display.

In some embodiments, the method further includes receiving a user's selection operation on the food ingredient control; in response to the selection operation on the food ingredient control, sending a recipe recommendation request to the server, where the recipe recommendation request includes a selection for the food ingredient control. The inventory ingredient name and the inventory ingredient quantity of the ingredient control; receiving a recipe recommendation list returned by the server in response to the recipe recommendation request, the recipe recommendation list including at least one item for the ingredient name and the recipe ingredient quantity of recipes; displaying the recipe recommendation list on the user interface of the display.

S120: In response to the recipe selection instruction, obtain a recipe ingredient set and a stock ingredient set. The recipe ingredient set includes the name of the recipe ingredient and the quantity of the recipe ingredient for the name of the recipe ingredient. The set of stock ingredients includes the name of the inventory ingredient and The quantity of the inventory ingredient for the inventory ingredient name.

In some embodiments, obtaining a set of recipe ingredients and a set of stock ingredients also includes if there is a name of the stock ingredient that is the same as the name of the recipe ingredient in the set of stock ingredients, and the number of the recipe ingredients is greater than the The quantity of ingredients in stock is added to the name of the recipe ingredients. According to the set of recipe ingredients after adding the inventory ID, a list of recipe ingredients is displayed in the user interface of the display. The list of recipe ingredients at least includes all the ingredients. The name of the recipe ingredient, the quantity of the recipe ingredient, and the inventory identification added to the name of the recipe ingredient.

In some embodiments, obtaining the recipe ingredient set and the inventory ingredient set further includes calculating the freshness of the inventory ingredients based on the current time and the time when the inventory ingredients are stored in the storage room; if the freshness is lower than a threshold, Then the inventory ingredient name and inventory ingredient quantity of the inventory ingredient are deleted from the inventory ingredient set.

In some embodiments, obtaining the recipe ingredient set and the inventory ingredient set further includes if there is an inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, and the inventory ingredient quantity is greater than the recipe If the quantity of ingredients is determined, a positioning request is sent to the server. The positioning request includes the name of the inventory ingredients and the interior image. The positioning request is used to request the server to mark the position of the image of the inventory ingredients in the interior image. , and returns the marked interior image; receives the marked interior image returned by the server; and displays the interior image in the user interface of the display.

S130: If there is the same name of the inventory ingredient as the name of the recipe ingredient in the set of inventory ingredients, and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient, according to the number of the recipe ingredient and the quantity of the inventory ingredient The quantity difference and the names of the recipe ingredients generate first list information, and a first purchase list corresponding to the first list information is displayed in the user interface of the display.

S140: If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, generate second list information based on the recipe ingredient name and the recipe ingredient quantity, and the user on the display The second purchase list corresponding to the second list information is displayed on the interface.

In some embodiments, the method further includes sending a purchase request to the server, the purchase request including the first list information and the second list information, and the purchase request is used to request the server to return a purchase request. Recommendation list, the purchase recommendation list at least includes purchase links for the first list information and the second list information; receiving the purchase recommendation list returned by the server; displaying the purchase in the user interface of the display Recommended list.

In some embodiments, the method further includes receiving a sharing instruction input by the user indicating sharing of the purchase list; in response to the sharing instruction, displaying a user list on the user interface of the display, the user list including connecting to the server the device identification of the terminal device; receiving the user's selection operation on the device identification in the user list; in response to the selection operation on the device identification, sending a synchronization instruction to the server, where the synchronization instruction includes the device identification, the first list information and the second list information. The synchronization instruction is used to instruct the server to send the first list information and the second list information to the server according to the device identification. Terminal Equipment.

For convenience of explanation, the above description has been made in conjunction with specific implementation modes. However, the above illustrative discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed. Various modifications and variations are possible in light of the above teachings. The above embodiments are selected and described to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various modified embodiments suitable for specific use considerations.

Claims

An electronic device, the electronic device includes:

A monitor for displaying content;

Communicator, used to communicate with external devices;

A processor, the processor is communicatively connected to the display, and the processor is configured to:

In response to the operation of recipe recommendation, determine the ingredient request information, where the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device;

Obtain recipes based on the ingredient information;

The display is controlled to display the recipe.
The electronic device according to claim 1, if the electronic device and the food storage device are not the same device, the processor is further configured to:

Obtain the LAN address of the food storage device connected to the same LAN as the electronic device;

Determine food ingredient request information according to the LAN address of the display device;

Send the food material request information according to the local area network address of the food material storage device;

Receive the ingredient information.
The electronic device of claim 2, the processor further configured to:

Determine and send address request information according to the LAN address of the display device, where the address request information is used to obtain the LAN address of the food storage device;

Receive address response information, where the address response information includes the local area network address of the food material storage device.
The electronic device according to claim 3, the address response information further includes login account information of the food storage device, and the login account information includes a user identification.
The electronic device of claim 4, the processor configured to:

Determine whether the login account information of the electronic device and the login account information of the food storage device are the same;

If they are the same, then determining and sending the food material request information based on the local area network address of the food material storage device, including:

Determine the food material storage device as the food material source device;

Determine the food material request information according to the LAN address of the food material source device;

Send the food material request information to the food material source device.
The electronic device according to claim 1, wherein the food material information includes food material category, food material name, food material storage time, and food material shelf life.
The electronic device according to claim 6, said obtaining recipes according to said ingredient information, is further configured to:

The expiration time of each food ingredient is determined based on the current time, the storage time of the food material and the shelf life of the food material, where the expiration time is the time from the current moment to the shelf life date of the food material;

Sort all the ingredients according to the expiration time of each ingredient, and determine the ingredient information of the ingredients that meet the first preset condition;

Send the ingredient information of the ingredient that meets the first preset condition to the server;

Receive a recipe from the server, where the recipe is determined by the server based on the ingredient information of the ingredient that meets the first preset condition.
The electronic device according to claim 1, further comprising:

The box has a storage room inside;

Food detector, used to collect interior images of the storage room;

The processor is also configured to:

Receive recipe selection instructions input by the user;

In response to the recipe selection instruction, a recipe ingredient set and a stock ingredient set are obtained. The recipe ingredient set includes the name of the recipe ingredient and the quantity of the recipe ingredient for the recipe ingredient name. The stock ingredient set includes the name of the inventory ingredient and the number of the recipe ingredient for the name. The quantity of the inventory ingredients stated in the name of the inventory ingredients;

If there is a name of the inventory ingredient that is the same as the name of the recipe ingredient in the set of inventory ingredients, and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient, according to the quantity difference between the quantity of the recipe ingredient and the quantity of the inventory ingredient value and the name of the recipe ingredient to generate first list information, and control the display to display the first purchase list corresponding to the first list information;

If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, generate second list information based on the recipe ingredient name and the recipe ingredient quantity, and control the display to display the third list information. The second purchase list corresponding to the information in the second list.
The electronic device of claim 8, the processor further configured to:

Before the step of receiving the recipe selection instruction input by the user, receive a control instruction input by the user instructing to identify the ingredients in stock;

In response to the control instruction, send a food ingredient identification request to the server, where the food ingredient identification request includes the interior image, and the food ingredient identification request is used to request the server to identify the interior image and return the inventory food set;

Receive the set of inventory ingredients returned by the server;

According to the set of inventory ingredients, an ingredient control for the name of the inventory ingredients is displayed on the display.
The electronic device of claim 9, the processor further configured to:

Receive the user's selection operation on the food ingredient control;

In response to the selection operation of the food ingredient control, send a recipe recommendation request to the server, where the recipe recommendation request includes the name of the inventory ingredient and the quantity of the inventory ingredient for the ingredient control;

Receive a recipe recommendation list returned by the server in response to the recipe recommendation request, where the recipe recommendation list includes at least one recipe for the ingredient name and the recipe ingredient quantity;

The recipe recommendation list is displayed on the display.
The electronic device of claim 8, the processor further configured to:

If there is a name of the inventory ingredient that is the same as the name of the recipe ingredient in the set of inventory ingredients, and the number of the inventory ingredients is greater than the number of the recipe ingredients, add an inventory identification to the name of the recipe ingredient;

According to the set of recipe ingredients after adding the inventory identification, a list of recipe ingredients is displayed on the display. The list of recipe ingredients at least includes the name of the recipe ingredient, the quantity of the recipe ingredient, and the addition of the name of the recipe ingredient. of the inventory identification.
The electronic device of claim 8, the processor further configured to:

Calculate the freshness of the inventory ingredients based on the current time and the time the inventory ingredients were stored in the storage room;

If the freshness is lower than the threshold, the inventory ingredient name and inventory ingredient quantity of the inventory ingredient are deleted from the inventory ingredient collection.
The electronic device of claim 8, the processor further configured to:

Send a purchase request to the server, the purchase request including the first purchase list and the second purchase list, The purchase request is used to request the server to return a purchase recommendation list, where the purchase recommendation list at least includes purchase links for the first purchase list and the second purchase list;

Receive the purchase recommendation list returned by the server;

The purchase recommendation list is displayed on the display.
The electronic device of claim 8, the processor further configured to:

Receive sharing instructions input by the user instructing to share the purchase list;

In response to the sharing instruction, display a user list on the display, where the user list includes the device identification of the terminal device connected to the same server as the electronic device;

Receive a user's selection operation on the device identification in the user list;

In response to the selection operation of the equipment identification, a synchronization instruction is sent to the server, the synchronization instruction includes the equipment identification, the first purchase list and the second purchase list, and the synchronization instruction is used to indicate The server sends the first purchase list and the second purchase list to the terminal device according to the device identification.
The electronic device of claim 8, the processor further configured to:

If there is a name of the stock ingredient that is the same as the name of the recipe ingredient in the set of stock ingredients, and the quantity of the stock ingredient is greater than the number of the recipe ingredient, a positioning request is sent to the server, and the positioning request includes the inventory The name of the food ingredient and the interior image, the positioning request is used to request the server to mark the location of the stock food image in the interior image, and return the marked interior image;

Receive the marked interior image returned by the server;

The interior image is displayed on the display.
A data processing method for electronic equipment, the method includes:

In response to the operation of recipe recommendation, the electronic device determines the ingredient request information, and the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device;

Obtain recipes based on the ingredient information;

The electronic device controls its display to display the recipe.
The method according to claim 16, if the electronic device and the food material storage device are not the same device, the operation in response to recipe recommendation, determining the food material request information includes:

Obtain the LAN address of the food storage device connected to the same LAN as the electronic device;

Determine food ingredient request information according to the LAN address of the electronic device;

Send the food material request information according to the local area network address of the food material storage device;

Receive the ingredient information.
The method according to claim 17, said obtaining the local area network address of a food storage device connected to the same local area network as the electronic device includes:

Determine and send address request information according to the LAN address of the electronic device, where the address request information is used to obtain the LAN address of the food storage device;

Receive address response information from the food material storage device, where the address response information includes the local area network address of the food material storage device.
The method of claim 16, further comprising:

After the electronic device controls its display to display the recipe, it receives a recipe selection instruction input by the user;

In response to the recipe selection instruction, a recipe ingredient set and a stock ingredient set are obtained. The recipe ingredient set includes the name of the recipe ingredient and the quantity of the recipe ingredient for the name of the recipe ingredient. The stock ingredient set includes the inventory ingredient. The name of the material and the quantity of the stocked food material corresponding to the name of the stocked food material;

If there is a name of the inventory ingredient that is the same as the name of the recipe ingredient in the set of inventory ingredients, and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient, according to the quantity difference between the quantity of the recipe ingredient and the quantity of the inventory ingredient value and the name of the recipe ingredient to generate first list information, and display the first purchase list corresponding to the first list information on the display;

If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, generate second list information based on the recipe ingredient name and the recipe ingredient quantity, and display the recipe ingredient on the display. The second purchase list corresponding to the second list information.