CN116263574A

CN116263574A - Intelligent refrigerator, server and interface display method

Info

Publication number: CN116263574A
Application number: CN202111536084.7A
Authority: CN
Inventors: 张宏波; 王金童
Original assignee: Qingdao Jukanyun Technology Co ltd
Current assignee: Qingdao Jukanyun Technology Co ltd
Priority date: 2021-12-15
Filing date: 2021-12-15
Publication date: 2023-06-16

Abstract

The application provides an intelligent refrigerator, a server and an interface display method, wherein the provided interface display method is applied to the intelligent refrigerator and comprises the following steps: receiving input selection operation of menu controls, and sending a menu information acquisition request to a server, wherein the menu information acquisition request comprises menu identifications and account identifications of the corresponding menu controls. Receiving a menu information set fed back by the server in response to the menu information acquisition request, wherein the menu information set comprises first menu information and second menu information corresponding to a menu identifier, the first menu information corresponds to first intelligent cooking equipment, the second menu information corresponds to second intelligent cooking equipment, and the first intelligent cooking equipment and the second intelligent cooking equipment are intelligent cooking equipment corresponding to an account identifier. When the user selects the menu, comprehensive comparison can be performed according to a plurality of different intelligent cooking devices and menu information corresponding to each intelligent cooking device, and the experience of the user is improved.

Description

Intelligent refrigerator, server and interface display method

Technical Field

The application relates to the technical field of communication, in particular to an intelligent refrigerator, a server and an interface display method.

Background

With the popularization of AIOT (artificial intelligence internet of things), intelligent refrigerators have various functions of providing users with intelligent management of food materials, intelligent storage, recommending menus, multifunctional cooking, and the like. Meanwhile, the intelligent refrigerator can be cooperated with other intelligent terminal equipment. For example, the intelligent refrigerator establishes communication connection with a plurality of intelligent cooking devices, and a user selects a menu in the intelligent refrigerator to control one of the intelligent cooking devices to cook according to the selected menu. In the process of selecting a menu by a user, a plurality of intelligent cooking devices support cooking according to the menu. But the device information and the menu information corresponding to each intelligent cooking device are different. For example, the intelligent electric cooker, the intelligent oven and the intelligent air fryer can make cakes according to cake recipes, but the operation convenience, the food material amount, the cooking power consumption and the cooking time length of the three devices are different.

However, when making a dish, the user may select only one intelligent cooking device and use the corresponding recipe supported by the device. Under the condition that a plurality of intelligent cooking devices exist, a user needs to select the intelligent cooking devices one by one and then inquire the corresponding menu so as to select the intelligent cooking devices and the corresponding menu which are suitable for the current needs. For example, when a user wants to make a cake, the user needs to select the intelligent electric cooker to perform cake recipe query, then select the intelligent oven to perform cake recipe query, and then make the cake by comparing the cake recipes of which equipment is determined to be used, so that the operation process is complicated.

Disclosure of Invention

The application provides an intelligent refrigerator, a server and an interface display method. The problems that a user cannot conduct recipe comparison among a plurality of intelligent cooking devices at the same time are solved.

In a first aspect, the present application provides an intelligent refrigerator, comprising:

a display;

a communicator for communicating with the intelligent cooking appliance;

a controller coupled to the display and the communicator configured to:

receiving input selection operation of menu controls, and sending a menu information acquisition request to a server, wherein the menu information acquisition request comprises menu identifications and account identifications corresponding to the menu controls;

receiving a menu information set fed back by a server in response to a menu information acquisition request, wherein the menu information set comprises first menu information and second menu information corresponding to a menu identifier, the first menu information corresponds to first intelligent cooking equipment, the second menu information corresponds to second intelligent cooking equipment, and the first intelligent cooking equipment and the second intelligent cooking equipment are intelligent cooking equipment corresponding to an account identifier;

and respectively displaying first menu information and second menu information in different areas of the menu detail page, displaying a first cooking control corresponding to the first menu information, and displaying a second cooking control corresponding to the second menu information, wherein the first cooking control is used for controlling the first intelligent cooking device to execute a cooking thread corresponding to the first menu information after receiving the selected operation of the user, and the second cooking control is used for controlling the second intelligent cooking device to execute a cooking thread corresponding to the second menu information after receiving the selected operation of the user.

In a second aspect, the present application provides a server comprising: the device comprises a memory and a processor, wherein program instructions are stored in the memory, and the processor executes the following steps by running the program instructions:

receiving a menu information acquisition request sent by an intelligent refrigerator, wherein the menu information acquisition request comprises a menu identifier and an account identifier corresponding to a menu control;

searching first menu information and second menu information corresponding to the menu identification according to the menu identification and the account identification, wherein the first menu information corresponds to first intelligent cooking equipment, the second menu information corresponds to second intelligent cooking equipment, and the first intelligent cooking equipment and the second intelligent cooking equipment are intelligent cooking equipment corresponding to the account identification;

and transmitting the first menu information, the second menu information, the first intelligent cooking equipment and the second intelligent cooking equipment to the intelligent refrigerator to form a menu information set.

In a third aspect, the present application provides an interface display method, applied to an intelligent refrigerator, including:

In a fourth aspect, the present application provides an interface display method, applied to a server, where the method includes:

According to the technical scheme, the intelligent refrigerator, the server and the interface display method are provided, and based on the provided interface display method, when a user selects a menu to be used in an intelligent user interface, comprehensive comparison can be performed according to a plurality of different intelligent cooking devices and menu information corresponding to each intelligent cooking device, and the user can intuitively select the menu. The user can control the selected intelligent cooking equipment to automatically start the cooking program through interaction with the intelligent refrigerator, so that the intelligent process from automatic matching of the menu, synchronizing of the menu to the intelligent cooking equipment and one-key start of the cooking program is realized, the user does not need to inquire the corresponding menu after selecting the intelligent cooking equipment one by one, and the user experience is improved while the operation is convenient.

Drawings

In order to more clearly illustrate the technical solutions of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

Fig. 1 illustrates a use scenario of a smart refrigerator illustrated according to an exemplary embodiment;

fig. 2A is a perspective view of a smart refrigerator according to an exemplary embodiment of the present application;

fig. 2B is a schematic view of the appearance of a smart refrigerator according to an exemplary embodiment of the present application;

fig. 3 is a schematic diagram of a hardware configuration of a smart refrigerator according to an exemplary embodiment of the present application;

FIG. 4 is a schematic diagram of a refrigerator screen user interface according to an exemplary embodiment of the present application;

FIG. 5 is a diagram of an account management details page according to an exemplary embodiment of the present application;

FIG. 6 is a diagram of a search device page according to an exemplary embodiment of the present application;

FIG. 7 is a schematic diagram of a device to be bound according to an exemplary embodiment of the present application;

FIG. 8 is a schematic diagram of a device status page according to an exemplary embodiment of the present application;

FIG. 9 is a schematic diagram of a refrigerator screen user interface according to an exemplary embodiment of the present application;

FIG. 10 is a schematic diagram of a menu resource page shown in accordance with an exemplary embodiment of the present application;

FIG. 11 is a schematic diagram of a recipe detail page shown in accordance with an exemplary embodiment of the present application;

FIG. 12 is a schematic diagram of a food management interface according to an exemplary embodiment of the present application;

FIG. 13 is a schematic diagram of a cooking alert message interface according to an exemplary embodiment of the present application;

FIG. 14 is a schematic diagram of interactions between a smart refrigerator and a server according to an exemplary embodiment of the present application;

fig. 15 is a schematic diagram of interaction between a smart refrigerator and a server according to an exemplary embodiment of the present application;

FIG. 16 is a schematic diagram of interactions between a smart refrigerator and a server according to an exemplary embodiment of the present application;

fig. 17 is a schematic diagram of interaction among the intelligent refrigerator, the server and the intelligent cooking device according to an exemplary embodiment of the present application.

Detailed Description

In order to better understand the technical solutions in the present application, the following description will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.

In the description of the present invention, it should be understood that the terms "center," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like indicate orientations or positional relationships based on the orientation or positional relationships shown in the drawings, merely to facilitate describing the present invention and simplify the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present invention.

The terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present invention, unless otherwise indicated, the meaning of "a plurality" is two or more.

In the description of the present invention, it should be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention will be understood in specific cases by those of ordinary skill in the art.

A schematic diagram of an operation scenario between the intelligent refrigerator, the control device, and the intelligent cooking appliance, which are illustrated according to an exemplary embodiment, is exemplarily shown in fig. 1. As shown in fig. 1, a user can operate a smart refrigerator 3 through a terminal device 2 and a control apparatus 1. Meanwhile, the user can operate the intelligent refrigerator 3 to control the electronic device 4.

The specific type of the control device 1, the terminal device 2, or the electronic device 4 is not limited in the embodiment of the present application.

In some embodiments, the control device 1 may be a remote controller, and the communication between the remote controller and the intelligent refrigerator includes infrared protocol communication or bluetooth protocol communication, other short-distance communication modes, and the like, and the intelligent refrigerator 3 is controlled by a wireless or other wired mode. The wireless mode can be direct connection or non-direct connection, and can be routed or not routed. The user can control the intelligent refrigerator 3 by inputting user instructions through keys on a remote controller, voice input, control panel input, and the like. Such as: the user can input corresponding control instructions through volume up-down keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, on-off keys and the like on the remote controller, so as to realize the function of controlling the intelligent refrigerator 3.

In some embodiments, terminal devices 2 such as cell phones, tablet computers, notebook computers, and other smart devices may also be used to control the smart refrigerator 3. The terminal device 2 can realize connection communication with the intelligent refrigerator 3 through a network communication protocol, and the purpose of one-to-one control operation and data communication is realized.

In some embodiments, the intelligent refrigerator may communicate with its associated electronic device 4. The electronic device 4 associated with the intelligent refrigerator includes electronic devices in the same local area network or the same network as the intelligent refrigerator, such as a display device, a portable mobile terminal device, a PC device, an intelligent cooking device, and the like in a home.

The communication manner between the devices is not limited in the embodiments of the present application.

The intelligent refrigerator 3 and the electronic device 4 also communicate data with the server 5 through various communication modes. The intelligent refrigerator 3 and the electronic device 4 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 5 may provide various contents and interactions to the smart refrigerator 3 and the electronic device 4. For example, the user may select food materials to be cooked and recipes corresponding to the food materials on the intelligent refrigerator 3, and the intelligent refrigerator 3 and the electronic device 4 control the electronic device 4 to automatically cook the food materials according to the selected recipes by sending and receiving information.

In some embodiments, the server 5 may be one cluster, or may be multiple clusters, and may include one or more types of servers. Other web service contents such as popular menu and cooking service are provided through the server 5.

The following describes a smart refrigerator in an embodiment of the present application with reference to the accompanying drawings.

Fig. 2A is a perspective view of an intelligent refrigerator according to an exemplary embodiment of the present application, where the intelligent refrigerator according to the embodiment of the present invention is approximately rectangular. The intelligent refrigerator is defined by a storage compartment 110 providing a limited storage space and a door 120 provided at an opening of the storage compartment. The storage chamber 110 is a case having an opening. In the example shown in fig. 2A, the storage compartment 110 includes a freezing compartment 111 located at a lower side and a refrigerating compartment 112 located at an upper side, the freezing compartment 111 and the refrigerating compartment 112 each have one or more independent storage spaces such as a drawer-type compartment 111A included in the freezing compartment 111, etc., and a plurality of receiving compartments 1121-1123 included in the refrigerating compartment 112, and the top illumination lamp 140 is located inside the receiving compartment 1121.

In the example shown in fig. 2A, a plurality of drawer compartments 111A are capped by drawer doors 111B. The refrigerating compartment 112 is divided into left and right sides, which are respectively covered by a door 112B pivotably mounted on the cabinet.

It should be noted that fig. 2A is an example of an embodiment of the present application, and the intelligent refrigerator shown in this fig. 2A does not constitute a limitation of the refrigerator provided in the present application. For example, in further embodiments of the present application, the intelligent refrigerator cabinet is divided into left and right sides, defining the left side cabinet as a freezer compartment and the right side cabinet as a refrigerator compartment, both of which may be capped by a door pivotally mounted to the cabinet. As another example, in further embodiments of the present application, the storage compartment includes a refrigerator compartment, a freezer compartment, and a temperature change compartment.

Based on the intelligent refrigerator provided by the embodiment, the display is arranged on the outer side of the intelligent refrigerator body, so that the refrigerator has a display function.

Fig. 2B is an external view schematically showing a smart refrigerator according to an exemplary embodiment of the present application, and as shown in fig. 2B, a display is provided on a door of a refrigerating chamber, and the display is embedded in a door body. A tag reading area is provided at a position below the display on the refrigerating chamber door, and an antenna for reading the RFID tag is built in the tag reading area for recognizing the RFID tag at a close distance.

In some embodiments, the screen of the display is flush with the outer surface of the door.

Fig. 3 is a schematic diagram of a refrigerator hardware configuration according to an exemplary embodiment of the present application, and as an example, the intelligent refrigerator 3 may include a display 210, a controller 220, a plurality of antennas 230 for detecting RFID tags, a detector 240, a memory 250, and several user input interfaces. The display 210, antenna 230, detector 240, and memory 250 are coupled to the controller 220 through a communication interface. The display 210 is configured to receive an image signal output from the controller 220, perform a component for displaying video contents and images and a menu manipulation interface, and display a user manipulation UI interface for controlling the refrigerator 200.

The controller 220 may include one or more processing units, such as a system on a chip (SoC), a central processing unit (central processing unit, CPU), a Microcontroller (MCU), a memory controller, and the like. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

In some embodiments, the controller 220 communicates with the antenna 230 via a serial port.

In some embodiments, the controller 220 includes an RFID module, the antenna 230, and the RFID tag form an RFID read/write system, the antenna 230 is used to transmit radio frequency signals between the RFID module and the RFID tag, and the RFID module performs read/write operations on the RFID tag through the antenna 230.

In some embodiments, the RFID module communicates with the antenna through a serial port.

Memory 250, which may include one or more memory units, may include, for example, volatile memory (volatile memory), such as: dynamic random access memory (dynamic random access memory, DRAM), static random access memory (static random access memory, SRAM), etc.; non-volatile memory (NVM) may also be included, such as: read-only memory (ROM), flash memory (flash memory), and the like. The different memory units may be separate devices or may be integrated or packaged in one or more processors or communication interfaces as part of the processors or communication interfaces.

The memory 250 stores program instructions and application programs such as voice applications. The controller 220 may call the program instructions in the memory 250 or run the application program to cause the refrigerator to perform a related method, such as the method for scanning food material labels provided in the embodiments of the present application.

The detector 240, including at least a sound collector, such as a microphone, may be used to receive the user's sound. Illustratively, a voice signal including a control instruction for a user to control the refrigerator 200. The detector 240 may further include a door opening/closing state sensor, such as a detecting magneto-sensitive switch, a mechanical switch, for detecting an opening/closing signal of each door, and transmitting opening/closing state information to the controller 220 when the opening/closing state of the door is recorded according to the detected opening/closing signal. Illustratively, when the detector detects an open signal or a close signal of any one of the doors, the latest switch state information is transmitted to the controller 220.

User input interfaces including at least one of a microphone, touch pad, sensor, keys, and other input interfaces. Such as: the user may implement a user command input function through actions such as voice, touch, gesture, press, etc., and the input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends the command signal to the controller 220.

A communicator 260 for communicating with the electronic device 4 within a server or local area network.

In some embodiments, the controller 220 may include a voice recognition module, which further includes a voice parsing unit and a voice command database, so that the refrigerator can independently perform voice recognition of voice data inputted by a user and a process of matching the recognized voice content with voice commands in the voice command database.

The number of antennas 230 is not limited in this application. For example, the antenna 230 may include an antenna disposed in each storage compartment and an antenna disposed inside the tag reading area, wherein the antenna disposed in each storage compartment is mainly used to scan the RFID tag in each storage compartment to read the tag information of the RFID tag, and the antenna disposed inside the tag reading area is mainly used to scan the RFID tag on the tag reading area to read the tag information of the RFID tag.

In some embodiments, the power of the antennas disposed in different storage compartments may be different. And the power of the antenna of each storeroom can ensure that the antenna recognizes the food materials contained in the own storeroom, so that the false recognition rate can be increased when the power is too high, and the food materials not contained in the own storeroom can be recognized when the power is too low. In a specific implementation, the power of the antenna may be determined in advance according to the space size of each storage chamber, and the power of each antenna may be set in the refrigerator, the larger the space, the larger the power.

In some embodiments, an antenna disposed under the tag reading area is referred to as a first antenna, and an antenna disposed in the storage room is referred to as a second antenna.

Based on the refrigerator provided by the embodiment of the application, the RFID tag can be used for identifying food materials in the storage room, and the tag information (such as the tag identification) of the RFID tag has a corresponding relation with the identified food materials and the food material information, so that virtual association between the RFID tag and the food material information is realized. In practical application, food materials attached with RFID tags are stored in the intelligent refrigerator, the RFID tags in the storage room are detected through the second antenna to obtain tag information, and the food materials marked by the tags are determined according to the association relation between the tag information and the food material information.

In some embodiments, the tag information includes tag codes, and particular code segments in the tag codes are tag identifications. The corresponding relation between the identification information of the RFID tag and the food material information is established, so that virtual association of the RFID tag and the food material can be realized. Further, after the tag identification of the RFID tag in the storage compartment is obtained, the food corresponding to the RFID tag can be determined according to the tag identification and the pre-established correspondence.

In some embodiments, the controller 220 implements the food management function by running a food management application that provides an application interface comprising: the system can be used as a food material management interface of an application main interface, a label editing interface for establishing the association relation between an RFID label and food material information, a menu display interface for displaying recommended menu information and the like.

In some embodiments, the controller 220 initiates the food management application in response to a power-on or user-entered food management application initiation instruction. After the food management application is started, the user can input a label editing instruction in the food management application. In response to the tag edit instruction, the food management application scans the RFID tag placed on the tag reading area by the user through the first antenna to obtain tag information, such as "a", of the RFID tag, and displays a tag edit interface. The user may enter food material information in the label editing interface for association with "a". The food material management application receives food material information input by a user, and establishes an association relationship between the food material information and 'A'. When the food material management application detects that the RFID tag 'A' exists in the storage room through the second antenna, real food materials in the storage room can be determined according to food material information related to the RFID tag 'A', and therefore intelligent management of the food materials is achieved. It should be appreciated that when the food material management application detects the presence of the RFID tag "a" in the storage compartment via the second antenna, the food material associated with "a" is the existing food material in the storage compartment.

In some embodiments, the food material information includes one or more of a food material ID, a food material name, a storage location identification, a number of food materials, a food material shelf life, a start time, and the like. The storage room for storing the food materials can be determined according to the storage position identification. For example, if the storage location identification contained in the food material information "apple" is "1", it is determined that "apple" is stored in the refrigerator compartment, and if the storage location identification contained in the food material information "apple" is "2", it is determined that "apple" is stored in the freezer compartment. The freshness of the food material may be determined based on the current time, the shelf life of the food material, and the starting time. The starting time may be the actual production date of the food material input by the user, such as the production date 2021 of the bread, 5 months and 1 days, or the time of placing the food material into the storage room.

In some embodiments, food material information corresponding to existing food materials in the storage compartment is stored in a local food material information set. The existing food material refers to food material currently stored in a refrigerator.

In other embodiments, the local food material information set may further store food material information corresponding to the historical food material. The history food material refers to food material stored in the refrigerator in the past and having been currently removed from the refrigerator. In particular, the existing food material and the history food material may be distinguished by storing the status flag, for example, the food material information of the history food material is marked as a moving-out status, and the food material information of the existing food material is marked as a putting-in status.

In other embodiments, the food material information of the existing food material and the food material information of the historical food material are stored in different sets of food material information.

In some embodiments, after the food management application is started, the food material information of the existing food material is read from the local food material information set, for example, the food material information in which the storage state is the put state is read. And then displaying a food material management interface according to the food material information of the existing food material, wherein the food material management interface comprises food material icons drawn according to the food material information, so that the existing food material in the refrigerator is displayed in the form of icons, pictures and texts and the like as many as possible. In addition, various functional controls, such as an RFID tag editing control, a food adding control, a menu recommending control, etc., can be displayed in the food management interface, so that the user can operate to trigger the controller 220 to realize corresponding functions.

The following describes a user interface on the side of the intelligent refrigerator according to the present application with reference to the accompanying drawings, and fig. 4 is a user interface, specifically an exemplary refrigerator screen user interface, shown in accordance with an exemplary embodiment of the present application. Referring to fig. 4, the refrigerator screen user interface includes a food management control 401, a menu control 402, an add food control 403, and an account management control 404, and further includes a temperature display area 405 corresponding to each storage chamber, a temperature increase control for adjusting a temperature, a temperature decrease control, and a plurality of mode controls 406, for example, the temperature corresponding to the refrigerating chamber is +6deg.C and the temperature corresponding to the freezing chamber is-21 deg.C. Wherein, the food material management control 401 displays various food materials stored in each storage room of the intelligent refrigerator after being selected by a user, so as to realize the intelligent management and intelligent storage functions of the food materials. The menu control 402 provides a plurality of menu information to the user in response to the user selecting operation to implement the intelligent menu function. The add food material control 403 performs input management on the food material which is not input after the user selects the operation. The account management control 404 controls the intelligent refrigerator to establish communication connection with a plurality of electronic devices to perform interactive cooperation after being selected and operated by a user.

In some embodiments, when the menu control is selected, the menu is recommended according to food materials stored in the refrigerator and the online intelligent cooking device. The refrigerator uploads the operation of triggering menu recommendation by the user to the server, the server determines food materials under the refrigerator according to the user identification and/or the refrigerator identification contained in the request, determines intelligent cooking equipment corresponding to the user identification, and then screens and filters the menu in the menu database, so that the finally recommended menu can be realized on the intelligent cooking equipment bound with the user identification, and meanwhile, the used food materials are not contained in the refrigerator. The embarrassment that a menu is recommended, but the user does not have corresponding intelligent cooking equipment or corresponding food materials is avoided.

In some embodiments, the account management control 404 in the refrigerator screen user interface is operated, referring to fig. 5, an account management detail page is displayed, a navigation bar and a content county and city area located below the navigation bar are displayed in a preset area in the account management detail page, and the content display area is changed along with the change of the selected control in the navigation bar. The navigation bar comprises an account login control, a search device control, a device binding control and a device state control. When a user actually uses the intelligent refrigerator, the user needs to log in an account first, and after the login is successful, the device for establishing communication connection needs to be bound with the account. After the searching and binding of the devices are completed in sequence, the devices can be controlled in a coordinated manner.

In some embodiments, the intelligent refrigerator may communicate with its associated electronic device. The electronic equipment associated with the intelligent refrigerator comprises terminal equipment which is in the same local area network or the same networking with the refrigerator, such as display equipment, portable mobile terminal equipment, PC equipment, intelligent cooking equipment and the like in families. The device associated with the intelligent refrigerator can also be a terminal device which is associated with the intelligent refrigerator based on the identity information. Wherein, intelligent cooking equipment can be like intelligent electric rice cooker, intelligent oven, intelligent electromagnetism stove, intelligent microwave oven etc.. In addition, the identity information may be device information, account information, etc., for example, an account registered by the food management application, that is, the registered account.

For example, an account logged in by a food management application on an intelligent refrigerator is referred to as a main service account. The terminal device associated with the intelligent refrigerator may be other terminal devices that log in the main service account, for example, when the user installs the food management application on the intelligent oven and logs in the food management application on the intelligent oven using the main service account, the intelligent oven is called a terminal device associated with the refrigerator. The terminal device associated with the intelligent refrigerator can be a terminal device for logging in a sub-service account bound with the main service account, for example, when a user installs a food management application on the intelligent induction cooker and logs in the food management application on the intelligent induction cooker by using the sub-service account bound with the main service account, the intelligent oven is called as the terminal device associated with the intelligent refrigerator.

As another example, the terminal device associated with the smart refrigerator may be a device bound through device information. For example, by binding the device information of the intelligent cooking device as described above with the device of the intelligent refrigerator, it becomes a terminal device associated with the intelligent refrigerator. It should be understood that the intelligent cooking device refers to a cooking device with an intelligent terminal, the intelligent terminal is provided with basic components of an electronic device such as a processor memory, and the intelligent terminal enables the cooking device to have functions such as data receiving and transmitting and data processing. Based on these functions, the intelligent cooking appliance generally has a function of receiving a remote operation instruction for automatic cooking. As described above, the intelligent refrigerator may communicate with its associated intelligent cooking appliance and server. For ease of description, the intelligent cooking appliance associated with the intelligent refrigerator is referred to as a bundled intelligent cooking appliance.

It should be noted that most intelligent cooking devices are limited by structures and placement positions, and it is difficult to set a large screen, and food materials to be cooked are stored in the intelligent refrigerator. And viewing stored food materials on a screen of the intelligent refrigerator, selecting a menu corresponding to the food materials, and starting a one-key cooking function, so that the operation of a user is facilitated.

The binding of the intelligent refrigerator and other intelligent cooking equipment in the embodiment of the application is further described below with reference to the accompanying drawings.

Referring to fig. 5, a user performs a selection operation on an account login control, an account login page is displayed, the user inputs an account and a password, and the user needs to complete account login after performing the operation on the login control, so that a subsequent search equipment task is facilitated. Further, fig. 6 is a schematic diagram of a search device page according to an exemplary embodiment of the present application, which is specifically a page displayed after a user completes account login.

For example, the intelligent refrigerator may search for the intelligent cooking device that may be the connection object in the local area network, or search for the intelligent cooking device that may be the connection object according to the identity information, which may be the device information, and the account identifier corresponding to the account information. Displaying a search device interface as shown in fig. 6, wherein the search device interface prompts a user to search for devices, the search device interface can also set a cancel control, and the user can stop searching for devices by clicking the cancel control in fig. 6, so that the initiated search fails.

In some embodiments, when the intelligent refrigerator searches for the intelligent cooking appliance, some anomalies may occur: for example, if the intelligent cooking device is not searched within a threshold time (for example, 20 seconds), namely, overtime, the user is required to be prompted that the intelligent cooking device is not found, a retry control and a cancel control can be set in the interface, the user clicks the retry control, the intelligent cooking device is started again, the user clicks the cancel control in the interface, the retry is canceled, and the initiated search fails; in particular to the actual situation.

For example, the smart refrigerator and the smart cooking device as a connection object need to be connected to the same WiFi. The intelligent refrigerator can search a plurality of intelligent cooking devices which are in the same WiFi network environment with the intelligent refrigerator, the searched intelligent cooking devices which can establish connection are listed in an interface, and when the intelligent cooking devices are searched in the local area network, the device list can be displayed on the interface of the device to be bound. As shown in fig. 7, fig. 7 is a page of a device to be bound, which is specifically a page displayed after a user completes a device search, according to an exemplary embodiment of the present application. Five intelligent cooking devices serving as connection objects and device information corresponding to each intelligent cooking device are displayed in a device page to be bound, wherein the device information comprises a device ID, a device model, a device name, an online state, a position and a power consumption index. Wherein, intelligent cooking equipment ID is intelligent electric rice cooker, intelligent oven 1, intelligent oven 2, air fryer 1 and air fryer 2 respectively. And the user selects at least one of the intelligent electric cooker, the intelligent oven 1 and the intelligent oven 2 as a binding object according to the displayed equipment information and the actual demand, for example, the user clicks the binding controls corresponding to the intelligent electric cooker, the intelligent oven 1 and the intelligent oven 2, so that the intelligent cooking equipment becomes the bound intelligent cooking equipment.

It should be noted that, the wireless communication technology provided in the present application includes, but is not limited to, wi-Fi (wireless local area network) technology, zigBee (ZigBee protocol) technology, bluetooth (Bluetooth) technology, and the like.

In particular, referring to fig. 14, fig. 14 is a schematic diagram illustrating interaction between a smart refrigerator and a server according to an exemplary embodiment of the present application. In S1401, the intelligent refrigerator responds to an account number input by a user. In S1402, a binding query request is sent to the server, where the binding query request carries an account identifier corresponding to the account. In S1403, the server searches a device information set according to an account identifier corresponding to the account identifier, where the device information set includes device information of at least one intelligent cooking device to be bound with the account identifier. In S1404, the set of device information is returned to the intelligent refrigerator. In S1405, the intelligent refrigerator receives a device information set returned by the server, where the device information set includes device information of at least one intelligent cooking device to be bound with the account identifier. In S1406, a device to be bound page is displayed, where the device to be bound page includes a control for displaying device information and a plurality of corresponding binding controls, where the binding controls are used for controlling the intelligent cooking device corresponding to the binding controls to establish a binding relationship with account information after receiving a selection operation of a user.

Exemplary, after the user clicks the binding controls corresponding to the intelligent electric cooker, the intelligent oven 1 and the intelligent oven 2, the binding between the intelligent cooking device and the account identifier is established. Fig. 8 is a schematic view of a device status page according to an exemplary embodiment of the present application, specifically, a page displayed after a user clicks a binding control. The device status page displays a device information control 801 corresponding to each intelligent cooking device and a control 802 that displays a binding success message. If the binding is successful, the control 802 is unbound, and if the binding fails, the control 802 is unbound. If the user wants to bind other devices again or retry the device with binding failure, the user can return to the page of the device to be bound in fig. 7 at any time to perform binding operation. It should be noted that, in this embodiment, only the first page in the pages is taken as an example, and all the pages may include multiple pages.

In particular, referring to fig. 15, fig. 15 is a schematic diagram illustrating interaction between a smart refrigerator and a server according to an exemplary embodiment of the present application. In S1501, the intelligent refrigerator receives an input selection operation of a binding control. In S1502, the intelligent refrigerator sends a binding request to a server, where the binding request includes device information corresponding to a binding control; the binding request is used for requesting the server to establish a binding relationship between at least one intelligent cooking device bound with the account number identification. In S1503, the server establishes a binding relationship between the intelligent refrigerator and at least one intelligent cooking device bound by the account identifier according to the device information corresponding to the binding control. In S1504, after the server establishes a binding relationship between the intelligent refrigerator and at least one intelligent cooking device, a binding success message is returned to the intelligent refrigerator. In S1505, a binding success message returned by the server is received, where the binding success message is used to indicate that the binding relationship between the account id corresponding to the account id and the intelligent cooking device has been successfully established. In S1506, a device status page is displayed, including a control for exposing device information and a control for exposing a bind success message.

In some embodiments, the above actions of account logging and binding with the intelligent cooking device may also be operated in a terminal device, such as an APP in a mobile phone. And (3) binding the intelligent cooking equipment which needs to establish communication connection by logging in an account number in the APP in the mobile phone.

In some embodiments, the intelligent refrigerator receives the latest operating state of each intelligent cooking appliance transmitted by the server. Generating an interface prompt comprising the latest running state, wherein the interface prompt is used for prompting the latest running state of each intelligent cooking equipment, and displaying the interface prompt on a user interface presented by a display.

For example, after a user successfully binds a plurality of intelligent cooking apparatuses to an account number registered on the intelligent refrigerator, since the apparatus states of all intelligent cooking apparatuses are changed. Such as a device being offline due to a failure to connect to the lan. For another example, the user moves a smart cooking device to change the location. Furthermore, all intelligent cooking devices need to be updated in device status according to a preset time interval or cycle timing. The purpose of updating the binding intelligent cooking equipment is to smoothly execute a cooking task later, and the purpose of updating the unbinding intelligent cooking equipment is to clearly perform binding selection when a user subsequently performs binding. The server sends the latest running state of each intelligent cooking device to the intelligent refrigerator at regular time according to a preset time interval or period, the intelligent refrigerator generates an interface prompt comprising the latest running state, for example, equipment information in a to-be-bound equipment page and equipment state page is updated, and a user can click any one of the two pages to acquire the latest equipment states of all intelligent cooking devices.

In some embodiments, the server obtains status information for all intelligent cooking devices; detecting whether current state information corresponding to the states of all intelligent cooking equipment is consistent with historical state information or not at every first time period. The historical state information is state information of all intelligent cooking equipment acquired by the server last time; and when the current state information is consistent with the historical state information, continuing to detect according to the interval time period. When the current state information is inconsistent with the historical state information, the current state information of all intelligent cooking equipment is obtained and sent to the intelligent refrigerator, and the intelligent refrigerator displays the current state information so as to update the historical state information.

In some embodiments, the intelligent refrigerator may also poll the status of each intelligent cooking appliance when the user queries the recipe.

It should be noted that, the intelligent cooking device bound with the account number of the intelligent refrigerator may also send its own status information to the server at regular time according to a preset time interval or period, so as to synchronize the device status of each intelligent cooking device subsequently. Further, the user may also manually update or manually edit the device information in the device page to be bound and the device status page, such as editing the ID and location of the bound device.

The implementation of the intelligent menu function on the intelligent refrigerator side is further described below with reference to fig. 9 to 12.

Fig. 16 is a schematic diagram showing interaction between a smart refrigerator and a server according to an exemplary embodiment of the present application. In 1601, the intelligent refrigerator receives an input selection operation of a recipe control. In 1602, a recipe information acquisition request is sent to a server, wherein the recipe information acquisition request includes a recipe identifier and an account identifier of a corresponding recipe control. In 1603, the server searches for first recipe information and second recipe information corresponding to the recipe identifier according to the recipe identifier and the account identifier, wherein the first recipe information corresponds to a first intelligent cooking device, the second recipe information corresponds to a second intelligent cooking device, and the first intelligent cooking device and the second intelligent cooking device are intelligent cooking devices corresponding to the account identifier. And forming a menu information set by the first menu information, the second menu information, the first intelligent cooking equipment and the second intelligent cooking equipment. In 1604, the server returns the set of recipe information to the intelligent refrigerator. In 1605, the intelligent refrigerator receives a menu information set fed back by the server in response to the menu information acquisition request, wherein the menu information set comprises first menu information and second menu information corresponding to a menu identifier, the first menu information corresponds to a first intelligent cooking device, the second menu information corresponds to a second intelligent cooking device, and the first intelligent cooking device and the second intelligent cooking device are intelligent cooking devices corresponding to an account identifier. In 1606, the intelligent refrigerator displays a menu detail page, first menu information and second menu information are respectively displayed in different areas of the menu detail page, a first cooking control is displayed corresponding to the first menu information, a second cooking control is displayed corresponding to the second menu information, wherein the first cooking control is used for controlling the first intelligent cooking device to execute a cooking thread corresponding to the first menu information after receiving a selected operation of a user, and the second cooking control is used for controlling the second intelligent cooking device to execute a cooking thread corresponding to the second menu information after receiving a selected operation of the user.

It should be noted that, each recipe corresponds to a unique recipe identifier, for example, a recipe blueberry cake sets "blueberry cake" as the recipe identifier. One recipe identifier can correspond to a plurality of recipe information, such as blueberry cakes can be cooked by a plurality of intelligent cooking devices. Each menu information corresponds to one device information. If the blueberry cakes correspond to each other, the two intelligent cooking devices can cook, wherein menu information corresponding to the two intelligent cooking devices is different. The two intelligent cooking devices are intelligent cooking devices corresponding to the account numbers.

In some embodiments, menu selection is performed after a user logs in to the intelligent refrigerator account and completes binding with at least one intelligent cooking device using the account identification, so as to facilitate subsequent performance of food cooking tasks. Referring to fig. 9, returning to the refrigerator screen user interface, after the user selects the menu control 402, the intelligent refrigerator is triggered to enter a menu resource page corresponding to the menu resource. The menu resource page includes a search bar 1001, a navigation bar 1002, and a content display area 1003 located below the navigation bar, the content display area 1003 including a plurality of menu controls 1004, such as "cake", "cookie", "European" and "puff", and the like. The content displayed in the content display area 1003 will change as the selected control in the navigation bar 1002 changes. The navigation bar 1002 includes a plurality of navigation controls, such as "recommended menu," "intelligent side dish," "menu allocation," and "intelligent menu," where each navigation control classifies a menu resource, and each corresponds to a different form of menu resource. When the menu resource page is displayed, a user can trigger entering a corresponding menu detail page by clicking any menu control or searching a target menu according to actual needs in a search column 1001 to input a menu detail page display instruction for the target menu.

For example, the user may trigger entry into a corresponding recipe detail page by clicking on the "cake" control in fig. 10 to enter a recipe detail page display instruction for a "cake" recipe. Referring to fig. 11, fig. 11 is a schematic diagram of a menu detail page shown in the present application according to an exemplary embodiment. The recipe detail page includes controls for presenting recipe information and corresponding device information and a plurality of cooking controls 1107. The sub-region (e.g., row region) corresponding to the specific step control 1103 is used for displaying operation step information of a plurality of recipes, the sub-region (e.g., row region) corresponding to the food material control 1104 is used for displaying food material information required by the plurality of recipes, and the sub-region (e.g., row region) corresponding to the cooking time length control 1105 is used for displaying cooking time length information of the plurality of recipes. The sub-region (e.g., row region) corresponding to the intelligent cooking device ID control 1101 is used for displaying a plurality of device information controls corresponding to a plurality of recipes, the sub-region (e.g., row region) corresponding to the device location control 1102 is used for displaying the location information of a plurality of devices corresponding to a plurality of recipes, and the sub-region (e.g., row region) corresponding to the device power consumption control 1106 is used for displaying the power consumption information of each of a plurality of devices corresponding to a plurality of recipes. The device information corresponding to each menu information is the device information of different intelligent cooking devices, and the menu information corresponding to each device information is also different.

As shown in fig. 11, the first recipe information, the second recipe information, and the third recipe information corresponding to the three intelligent cooking devices of the intelligent electric cooker, the intelligent oven 1, and the intelligent oven 2 are sequentially from left to right. Each menu occupies a display area (illustratively, a column area). The intelligent electric cooker corresponding to the first menu information is first intelligent cooking equipment. The intelligent oven 1 corresponding to the second recipe information is a second intelligent cooking device. The intelligent oven 2 corresponding to the third recipe information is a third intelligent cooking device. The first intelligent cooking equipment, the second intelligent cooking equipment and the third intelligent cooking equipment are intelligent cooking equipment corresponding to account numbers of the login account numbers of the intelligent refrigerator.

In some embodiments, the information is displayed in a list manner, each area corresponds to a column of data, and each area may further include a plurality of row entries, as shown in fig. 11, from top to bottom, it can be seen that a row where a device is located is a row where a position control 1102 is located, where the intelligent electric cooker, the intelligent oven 1, and the intelligent oven 2 are located, and a row where a specific step control 1103 is located is used to display specific operation steps and corresponding operation pictures in menu information corresponding to three intelligent cooking devices, so that a user can perform a subsequent cooking task conveniently. The row where the food material control 1104 is located is used for displaying the specific food material type used in the menu information corresponding to the three intelligent cooking devices and the component corresponding to each food material. The row where the cooking time length control 1105 is located is used for displaying the cooking time length in the menu information corresponding to the three intelligent cooking devices, so that a user can intuitively know the cooking time required by cooking, and the cooking time length is determined according to the cooking curve corresponding to each menu information. The row in which the device power consumption control 1106 is located is used to display power consumption parameters corresponding to three intelligent cooking devices.

It should be noted that, respectively displaying a plurality of menu information in different areas of the menu detail page, and displaying a plurality of cooking controls corresponding to the plurality of menu information, when a user selects any one cooking control to operate, the intelligent refrigerator controls the intelligent cooking equipment corresponding to the cooking control to execute cooking work according to the corresponding menu information.

As can be seen from the above embodiments, when a user has a plurality of intelligent cooking apparatuses of different types and models at home, the plurality of intelligent cooking apparatuses may support cooking during a dish making process, but the placement positions of the intelligent cooking apparatuses are far and near, the size of the food that can be contained, the cooking time and the cooking energy consumption may be different. Through the menu detail page provided by the application, a user can comprehensively compare a plurality of intelligent cooking devices and menu information corresponding to each intelligent cooking device in the menu detail page so as to accurately select the intelligent cooking devices and corresponding menus according to actual demands and control the intelligent cooking devices to finish cooking according to the corresponding menus. It should be noted that, in the embodiment of the present application, only one intelligent cooking device is controlled to start the intelligent flow of the one-key cooking program, and meanwhile, a plurality of intelligent cooking devices may be started, which may be specifically set according to the actual situation.

In some embodiments, the device information corresponding to the menu information in the menu information set includes a device state, the intelligent refrigerator sorts the menu information and the device information corresponding to the menu information according to the device state, and the sorted menu information and the device information corresponding to the menu information are sequentially displayed in the menu detail page.

Illustratively, the first menu information and the second menu information are ordered according to the state of the first intelligent cooking device and the state of the second intelligent cooking device, and the menu information corresponding to the online intelligent cooking device is arranged in front of the menu information corresponding to the online intelligent cooking device; and respectively displaying the first menu information and the second menu information in different areas of the menu detail page according to the sequence. The off-line intelligent cooking appliance includes an off-line state and an unbound appliance.

And after receiving the menu information set, the intelligent refrigerator screens and sorts according to the unique state identifiers of the states of the equipment. Sequencing from front to back sequentially according to the online state, the offline state and the unbound equipment, for example, sequencing the menu corresponding to the intelligent cooking equipment in the current online state in front; secondly, a menu corresponding to the intelligent cooking equipment in the offline state of the user; and finally, the menu corresponding to the intelligent cooking equipment which is not bound by the user is obtained. Referring to fig. 11, the offline state devices in the device states are specially marked to generate a state prompt identifier 1114 so that the user can more intuitively understand each device state. Furthermore, after classifying and sequencing the intelligent cooking devices in different states, a user can comprehensively compare and select the intelligent cooking devices in the on-line state according to the device state of each intelligent cooking device, so that the situation that the selected intelligent cooking devices cannot execute cooking tasks after being in the off-line state is avoided.

In some embodiments, the menu detail page displays menu information in a list manner, different menu information is located in different columns in the list, content parameters displayed in each row in the same menu information are different, and each menu information comprises food material parameters and cooking duration parameters. In the M-th row, comparing food material parameters in each menu information, generating a food material evaluation identifier at a position of the M-th row corresponding to the N-th column, wherein the food material evaluation identifier is used for prompting a user to select the menu information of the N-th column according to the food material evaluation identifier, and the M-th row is used for displaying the food material parameters of each menu; or in the A line, comparing the cooking time length parameters in each menu information, and generating a time length evaluation identifier corresponding to the B column position of the A line, wherein the time length evaluation identifier is used for prompting a user to select the menu information corresponding to the B column according to the time length evaluation identifier.

For example, referring to fig. 11, in line 4, food parameters in the menu information corresponding to each intelligent cooking apparatus are displayed by a food material control 1104, and specifically, the food material parameters include the used food materials and components corresponding to the food materials. The intelligent electric cooker has the food parameters of 2 eggs, 120 g of refined white sugar, 100 g of low-gluten powder, 12 g of cream and 12 ml of milk. The food parameters of the intelligent oven 1 are '3 eggs, 150 g of refined white sugar, 120 g of low gluten powder, 15 g of cream and 15 ml of milk'. The food parameters of the intelligent oven 2 are '5 eggs, 240 g of refined white sugar, 3000 g of low gluten powder, 40 g of cream and 40 ml of milk'. The intelligent refrigerator compares the identification of each food component in the food parameters of each menu to obtain the component size ordering among each menu. And (3) carrying out special marking on the food material parameter with the largest component, and generating a food material evaluation mark 1111 corresponding to the 3 rd column on the 4 th row, so that a user can more intuitively and transversely compare the food material parameters in each menu information.

The recipe information in the recipe information set further includes a cooking curve corresponding to each recipe, where the cooking curve is a curve for measuring a time-dependent temperature change relationship of the food material during cooking. And obtaining the cooking time length parameter corresponding to each menu through the cooking curve corresponding to each menu. Specifically, in the recipe information corresponding to each intelligent cooking device in line 5, the cooking duration is displayed by the cooking duration control 1105, and the cooking duration parameter of the intelligent cooking device is "2 hours and 30 minutes". The cooking duration parameter of the intelligent oven 1 is "1 hour 20 minutes". The cooking duration parameter of the intelligent oven 2 is "50 minutes". The intelligent refrigerator compares the time marks in the cooking duration parameters of each menu to obtain the cooking duration length ordering among each menu. And (3) specially marking the cooking duration parameter with the shortest cooking duration, wherein the 5 th row corresponds to the 3 rd column to generate a duration evaluation identifier 1112 so as to enable a user to more intuitively and transversely compare the cooking duration in each menu information.

In some embodiments, the menu detail page further displays, in a list manner, that the device information corresponding to the intelligent cooking device includes a location parameter and a power consumption parameter, and in the E-th row, the intelligent refrigerator compares the location parameter in each device information, and in the E-th row, the location evaluation identifier is generated corresponding to the F-th column. The location evaluation identification is used for prompting a user to select the corresponding intelligent cooking equipment according to the location evaluation identification. Meanwhile, in the H line, the intelligent refrigerator compares the power consumption parameters in the information of each device, and in the H line, a power consumption evaluation mark is generated corresponding to the I column. The power consumption evaluation identification is used for prompting a user to select the corresponding intelligent cooking equipment according to the power consumption evaluation identification. And synchronously displaying the position evaluation identification and the power consumption evaluation identification to a menu detail page. The power consumption parameter is calculated by a cooking curve in the menu information and a power consumption index of the intelligent cooking device corresponding to the menu.

For example, the location parameter corresponding to each intelligent cooking appliance is displayed by a location control 1102, see fig. 11, and the location parameter of the intelligent electric cooker is "restaurant-table". The location parameter of the intelligent oven 1 is "kitchen-on-counter". The location parameter of the intelligent oven 2 is "kitchen-embedded cabinet". And the intelligent refrigerator compares the distance identifiers in the position parameters corresponding to each intelligent cooking device to obtain the distance length ordering among each intelligent cooking device. The position parameter with the shortest distance is specially marked, and a position evaluation mark 1110 is generated corresponding to the 1 st column in the 2 nd row, so that a user can more intuitively and transversely compare the position of each intelligent cooking device.

For example, the power consumption parameter corresponding to each intelligent cooking appliance is displayed by the appliance power consumption control 1106, see fig. 11, and the power consumption parameter of the intelligent electric cooker is "1.9 degrees". The power consumption parameter of the intelligent oven 1 is between 1.68 degrees. The power consumption parameter of the intelligent oven 2 is '2.6 degrees'. And the intelligent refrigerator compares the power identifications in the power consumption parameters corresponding to each intelligent cooking device to obtain the power consumption degree ordering among each intelligent cooking device. And (3) carrying out special marking on the power consumption parameter with the lowest power consumption, and generating a power consumption evaluation mark 1113 corresponding to the 2 nd column on the 6 th row so as to enable a user to more intuitively and transversely compare the power consumption of each intelligent cooking device.

In some embodiments, the user may make a food material selection in advance, and a recipe selection after the food material selection is completed. Fig. 12 is a diagram illustrating a food management interface according to an exemplary embodiment of the present application, specifically, an interface entered after clicking on the food management control 401 in fig. 4. Referring to fig. 12, the food management interface includes an RFID tag editing control 1201, an add food control 1202, and a menu recommendation control 1203, and further includes food display areas corresponding to respective storage compartments, such as a food display area corresponding to a refrigerator compartment, a food display area corresponding to a temperature change compartment, and a food display area corresponding to a cold greenhouse. Each food material display area displays food material icons corresponding to each food material in the storage room, such as mutton and pork in the food material display area, sausage and fish cake in the food material display area and lettuce, eggs and carrots in the food material display area. Each food material icon includes a food material picture and a food material name.

In some embodiments, a user may enter the above-described label editing instructions by manipulating RFID label editing control 301 in the food management interface. The user may also perform food entry by operating the add food control 1202 in the food management interface. The user can also input a menu recommendation instruction and trigger to enter the menu resource page by operating the menu recommendation control 1203 in the food management interface. The specific operation of the user on the intelligent refrigerator side and the specific interaction between the intelligent refrigerator and the server are the same as those described in the above embodiments, and are not repeated here.

In some embodiments, after the menu detail page is displayed, the intelligent refrigerator receives an input selection operation of the cooking control, and sends a cooking instruction to the intelligent cooking device corresponding to the cooking control, wherein the cooking instruction is used for instructing the intelligent cooking device to execute a cooking task according to the menu information.

The method specifically includes that after a user selects a cooking control corresponding to the intelligent oven 1 in a menu detail page, a cooking reminding message of one-key cooking is triggered. The cooking reminding message is displayed at a preset position on the menu detail page, a confirmation control 1301 and a cancellation control 1302 are arranged on a display interface of the cooking reminding message, and a user needs to confirm the cooking reminding message after operating the confirmation control 1301 so as to realize cooking of the follow-up intelligent cooking equipment. If the user does not want to continue with the subsequent cooking operation, the cancel control 1302 may be operated to close the cooking reminder information. The cooking reminding message display mode can also automatically disappear after a threshold time (such as 10 seconds). Thus, in other embodiments of the present application, the alert message method is not limited to the alert message method, and the alert message method includes, but is not limited to, the alert message method may be in the form of a voice notification, may be in the form of a bell, and may be in other forms such as vibration.

In some embodiments, a user clicks a confirmation control in the start one-touch cooking interface to input an instruction indicating to perform a cooking task according to recipe information. Fig. 17 is a schematic diagram of interaction among the intelligent refrigerator, the server and the intelligent cooking device according to an exemplary embodiment of the present application. In S1701, the intelligent refrigerator receives an input operation of a cooking control. In response to the operation, a cooking request including recipe information corresponding to the cooking control is transmitted to the server, the cooking request requesting the server to transmit the recipe information to the corresponding intelligent cooking device in S1702. In S1703, the server transmits recipe information to the intelligent cooking appliance, wherein the recipe information includes a cooking curve to control the intelligent cooking appliance to cook according to the cooking curve.

In some embodiments, the user may control the intelligent refrigerator to send the recipe information to the intelligent cooking device corresponding thereto by clicking the confirmation control. In the specific implementation, the intelligent refrigerator responds to the click operation of a user on the confirmation control, determines the intelligent cooking equipment corresponding to the menu information according to the equipment information corresponding to the menu information, and sends the menu information to the intelligent cooking equipment.

In some embodiments, after sending the first cooking instruction to the first intelligent cooking device corresponding to the first cooking control, the intelligent refrigerator detects a food material put state of the first intelligent cooking device and the second intelligent cooking device, the food material put state being a state in which a target food material is put in the intelligent cooking device. If the food material putting state of the first intelligent cooking equipment is not detected within the preset time, and after the food material putting state of the second intelligent cooking equipment is detected, a prompting page comprising corresponding prompting information is generated, a preset area of the prompting page is provided with a switching control, and the switching control is used for switching a cooking instruction to the second intelligent cooking equipment after receiving the selected operation of a user so as to control the second intelligent cooking equipment to execute a corresponding cooking thread.

In some embodiments, in response to a selected operation of the switch control, a cooking undo instruction is sent to the first intelligent cooking device, while a second cooking instruction is sent to the second intelligent cooking device, the second cooking instruction being for instructing the second intelligent cooking device to execute a corresponding cooking thread according to the second recipe information.

For example, after the user selects the first cooking control corresponding to the intelligent oven 1 and clicks the confirmation control, the intelligent refrigerator detects the device states of the plurality of intelligent cooking devices, where the device states include a food material placement state. If the user does not put the target food material into the first intelligent cooking equipment within the preset time, but put the target food material into the second intelligent cooking equipment, the intelligent refrigerator controls the display to display a prompt page comprising corresponding prompt information after detecting the food material put-in state of the second intelligent cooking equipment. The page is displayed with a switching control, after the user selects the switching control, the intelligent refrigerator responds to the selected operation of the user, and sends a cooking cancel instruction to the first intelligent cooking equipment and simultaneously sends a second cooking instruction to the second intelligent cooking equipment so as to control the second intelligent cooking equipment to execute subsequent cooking tasks. Through switching the cooking instruction, the user can change and switch at will according to the finally selected intelligent cooking equipment, and the problem of clicking errors is not worried about. Meanwhile, the use scene is increased, and meanwhile, the user operation is more convenient. It should be noted that, the recipe information in the application includes but is not limited to the first recipe information and the second recipe information, and similarly, the intelligent cooking device includes but is not limited to the first intelligent cooking device and the second intelligent cooking device, and can be set according to the actual situation.

In some embodiments, after sending the first cooking instruction to the first intelligent cooking device corresponding to the first cooking control, the intelligent refrigerator detects a food material put state of the first intelligent cooking device and the second intelligent cooking device, the food material put state being a state in which a target food material is put in the intelligent cooking device. If the food material putting state of the first intelligent cooking equipment is not detected within the preset time, a prompt page comprising corresponding prompt information is generated, a prompt control is displayed in a preset area of the prompt page, and the prompt control is used for prompting a user to confirm whether to continue cooking.

In some embodiments, the first intelligent cooking appliance, upon detecting the insertion of the target food item, characterizes the insertion successfully in feedback to identify the intelligent refrigerator, so that the intelligent refrigerator exits the menu detail page. In some embodiments, the target food material is a food material corresponding to the selected recipe.

In some embodiments, the placement of the target food items may be characterized by the opening and closing action of the intelligent cooking appliance door cover, or by an image/weight sensor to compare with the food items removed from the refrigerator.

According to the technical scheme, a user can interact with the interface object displayed on the screen of the intelligent refrigerator to search, view or select a menu and then start cooking. After cooking is started, the intelligent oven can automatically control parameters such as time, temperature and the like according to menu information included in a menu selected by a user, so that a one-key cooking function is realized.

The above UI is exemplified by a smart refrigerator, the interactive contents are exemplified by a smart refrigerator, a server and a smart cooking device, and the UI of other types of smart refrigerators in terms of interface display is basically similar to the above UI, and is not listed here. The UI interface provided in this application is merely exemplary, and is specific to actual application and design.

According to the above embodiments, the embodiments of the present application further provide a server, including: the device comprises a memory and a processor, wherein program instructions are stored in the memory, and the processor executes the following steps by running the program instructions:

and receiving a menu information acquisition request sent by the intelligent refrigerator, wherein the menu information acquisition request comprises a menu identifier and an account identifier corresponding to a menu control. Searching first menu information and second menu information corresponding to the menu identification according to the menu identification and the account identification, wherein the first menu information corresponds to the first intelligent cooking device, the second menu information corresponds to the second intelligent cooking device, and the first intelligent cooking device and the second intelligent cooking device are intelligent cooking devices corresponding to the account identification. And transmitting the first menu information, the second menu information, the first intelligent cooking equipment and the second intelligent cooking equipment to the intelligent refrigerator to form a menu information set.

The embodiment of the application also provides an interface display method which can be executed on the intelligent refrigerator side, and an execution main body of the method is a controller in the intelligent refrigerator. The method comprises the following steps: receiving input selection operation of menu controls, and sending a menu information acquisition request to a server, wherein the menu information acquisition request comprises menu identifications and account identifications of the corresponding menu controls. Receiving a menu information set fed back by the server in response to the menu information acquisition request, wherein the menu information set comprises first menu information and second menu information corresponding to a menu identifier, the first menu information corresponds to first intelligent cooking equipment, the second menu information corresponds to second intelligent cooking equipment, and the first intelligent cooking equipment and the second intelligent cooking equipment are intelligent cooking equipment corresponding to an account identifier. And respectively displaying first menu information and second menu information in different areas of the menu detail page, displaying a first cooking control corresponding to the first menu information, and displaying a second cooking control corresponding to the second menu information, wherein the first cooking control is used for controlling the first intelligent cooking device to execute a cooking thread corresponding to the first menu information after receiving the selected operation of a user, and the second cooking control is used for controlling the second intelligent cooking device to execute the cooking thread corresponding to the second menu information after receiving the selected operation of the user.

The embodiment of the application also provides an interface display method which can be executed on the server side, and an execution main body of the method is a processor in the server. The method comprises the following steps: and receiving a menu information acquisition request sent by the intelligent refrigerator, wherein the menu information acquisition request comprises a menu identifier and an account identifier corresponding to a menu control. Searching first menu information and second menu information corresponding to the menu identification according to the menu identification and the account identification, wherein the first menu information corresponds to the first intelligent cooking device, the second menu information corresponds to the second intelligent cooking device, and the first intelligent cooking device and the second intelligent cooking device are intelligent cooking devices corresponding to the account identification. And transmitting the first menu information, the second menu information, the first intelligent cooking equipment and the second intelligent cooking equipment to the intelligent refrigerator to form a menu information set.

According to the technical scheme, based on the provided interface display method, after a user selects a menu in a user interface of the intelligent refrigerator, a plurality of menu information and equipment information corresponding to the menu information are displayed in the user interface, and the equipment information corresponding to each menu information is equipment information of different intelligent cooking equipment. The intelligent cooking equipment is used for comprehensively comparing the conditions of a plurality of intelligent cooking equipment, and a user does not need to inquire corresponding menus after selecting the intelligent cooking equipment one by one. So that a user can conduct recipe comparison among a plurality of intelligent cooking devices at the same time.

In a specific implementation, the present invention further provides a storage medium, where the storage medium may store a program, and the program may include some or all of the steps in each embodiment of the media asset playing duration reporting method provided by the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a random-access memory (random access memory, RAM), or the like.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. An intelligent refrigerator, comprising:

a display;

a communicator for communicating with the intelligent cooking appliance;

a controller coupled to the display and the communicator configured to:

Receiving input selection operation of a menu control, and sending a menu information acquisition request to a server, wherein the menu information acquisition request comprises a menu identifier and an account identifier corresponding to the menu control;

receiving a menu information set fed back by a server in response to the menu information acquisition request, wherein the menu information set comprises first menu information and second menu information corresponding to the menu identifier, the first menu information corresponds to first intelligent cooking equipment, the second menu information corresponds to second intelligent cooking equipment, and the first intelligent cooking equipment and the second intelligent cooking equipment are intelligent cooking equipment corresponding to the account identifier;

the method comprises the steps of respectively displaying first menu information and second menu information in different areas of a menu detail page, displaying a first cooking control corresponding to the first menu information, and displaying a second cooking control corresponding to the second menu information, wherein the first cooking control is used for controlling a first intelligent cooking device to execute a cooking thread corresponding to the first menu information after receiving a selected operation of a user, and the second cooking control is used for controlling a second intelligent cooking device to execute a cooking thread corresponding to the second menu information after receiving a selected operation of the user.

2. The intelligent refrigerator of claim 1, wherein the set of recipe information further includes a first intelligent cooking device state and a second intelligent cooking device state, the receiving server respectively displaying the first recipe information and the second recipe information in different areas of the recipe detail page, further comprising:

sequencing the first menu information and the second menu information according to the first intelligent cooking equipment state and the second intelligent cooking equipment state, wherein the menu information corresponding to the online intelligent cooking equipment is arranged in front of the menu information corresponding to the online intelligent cooking equipment;

and respectively displaying the first menu information and the second menu information in different areas of the menu detail page according to the sequence.

3. The intelligent refrigerator according to claim 2, wherein the menu detail page displays menu information in a list mode, different menu information is located in different columns in the list, content parameters displayed in each row in the same menu information are different, and each menu information comprises food material parameters and cooking duration parameters; the controller is further configured to:

Comparing the food parameters in each menu information in an M-th row, and generating a food evaluation identifier at a position of the M-th row corresponding to an N-th column, wherein the food evaluation identifier is used for prompting a user to select the menu information of the N-th column according to the food evaluation identifier, and the M-th row is used for displaying the food parameters of each menu; or (b)

And in the A line, comparing the cooking time length parameters in each menu information, and generating a time length evaluation identifier corresponding to the B column at the A line, wherein the time length evaluation identifier is used for prompting a user to select the menu information corresponding to the B column according to the time length evaluation identifier.

4. The intelligent refrigerator of claim 1, wherein prior to receiving the input selection of menu controls, further comprising:

responding to input account information, and sending a binding inquiry request to a server, wherein the binding inquiry request carries an account identifier corresponding to the account information;

receiving a device information set returned by a server, wherein the device information set comprises device information of at least one intelligent cooking device to be bound with the account identification;

Displaying a to-be-bound equipment page, wherein the to-be-bound equipment page comprises a control for displaying equipment information and a plurality of corresponding binding controls, and the binding controls are used for controlling the intelligent cooking equipment corresponding to the binding controls to establish a binding relation with the account information after receiving the selected operation of a user.

5. The intelligent refrigerator of claim 1, wherein after the menu detail page is displayed, the controller is further configured to:

receiving input selection operation of the first cooking control, and sending a first cooking instruction to the first intelligent cooking device corresponding to the first cooking control, wherein the first cooking instruction is used for indicating the first intelligent cooking device to execute a cooking task according to the first menu information.

6. The intelligent refrigerator of claim 5, wherein after the sending a first cooking instruction to the first intelligent cooking appliance corresponding to the first cooking control, the controller is further configured to:

detecting the food material placing states of the first intelligent cooking equipment and the second intelligent cooking equipment, wherein the food material placing states are states of placing target food materials in the intelligent cooking equipment;

If the food material putting state of the first intelligent cooking device is not detected within the preset time, and after the food material putting state of the second intelligent cooking device is detected, a prompting page comprising corresponding prompting information is generated, a preset area of the prompting page is provided with a switching control, and the switching control is used for switching the cooking instruction to the second intelligent cooking device after receiving the selected operation of a user so as to control the second intelligent cooking device to execute a corresponding cooking thread.

7. The intelligent refrigerator of claim 6, wherein the controller is further configured to:

and responding to the selected operation of the switching control, sending a cooking cancel instruction to the first intelligent cooking equipment, and simultaneously sending a second cooking instruction to the second intelligent cooking equipment, wherein the second cooking instruction is used for indicating the second intelligent cooking equipment to execute a corresponding cooking thread according to the second menu information.

8. A server, comprising: the device comprises a memory and a processor, wherein the memory stores program instructions, and the processor executes the following steps by running the program instructions:

searching first menu information and second menu information corresponding to the menu identifier according to the menu identifier and the account identifier, wherein the first menu information corresponds to first intelligent cooking equipment, the second menu information corresponds to second intelligent cooking equipment, and the first intelligent cooking equipment and the second intelligent cooking equipment are intelligent cooking equipment corresponding to the account identifier;

and transmitting the first menu information, the second menu information, the first intelligent cooking equipment and the second intelligent cooking equipment to an intelligent refrigerator to form a menu information set.

9. An interface display method applied to an intelligent refrigerator is characterized by comprising the following steps:

receiving a menu information set fed back by a server in response to the menu information acquisition request, wherein the menu information set comprises first menu information and second menu information corresponding to the menu identifier, the first menu information corresponds to first intelligent cooking equipment, the second menu information corresponds to second intelligent cooking equipment, and the first intelligent cooking equipment and the second intelligent cooking equipment are intelligent cooking equipment corresponding to the account identifier; the method comprises the steps of respectively displaying first menu information and second menu information in different areas of a menu detail page, displaying a first cooking control corresponding to the first menu information, and displaying a second cooking control corresponding to the second menu information, wherein the first cooking control is used for controlling a first intelligent cooking device to execute a cooking thread corresponding to the first menu information after receiving a selected operation of a user, and the second cooking control is used for controlling a second intelligent cooking device to execute a cooking thread corresponding to the second menu information after receiving a selected operation of the user.

10. An interface display method applied to a server, the method comprising: