CN115191839A - Method for displaying cooking state of cooking appliance, cooking appliance and control system thereof - Google Patents

Abstract

A method for displaying the cooking state of a cooking appliance, a cooking appliance and a control system thereof. The method shows the dynamic identification of the cooking state of the cooking appliance and the whole process of the intervention measures from the beginning to the end in an intuitive way to the user, so that the user can understand how the intelligent control of the cooking appliance works, which is the precise control What is done in the cooking process, so as to intuitively feel the intelligence and commercial value of the cooking equipment, and improve the user experience.

Description

Method for displaying cooking state of cooking appliance, cooking appliance and control system thereof

technical field

Embodiments of the present invention relate to the technical field of household appliances, and in particular, to a method for displaying a cooking state of a cooking appliance, a cooking appliance and a control system thereof.

Background technique

In recent years, cooking equipment including microwave ovens, ovens, etc. have been used more and more widely, becoming one of the indispensable household appliances in every household. Generally, existing cooking devices can only heat food mechanically according to parameters such as time and temperature set by the user. In this case, it is easy to cause the food to be overcooked or even burnt, or the food cannot reach maturity under the set parameters due to insufficient cooking, requiring the user to increase the cooking time or temperature. It can be seen that the cooking device is not intelligent enough, the cooking effect is not good, and the user experience is not good.

For the above situation, an oven in the prior art acquires its internal image through a camera and presents it to the user, so that the user can know the cooking state of the food. However, the solution of presenting the cooking state of the internal food still requires the user to adjust the cooking parameters according to the observed images. If the user does not intervene in time, the cooking effect will also be affected, and the working process cannot be intelligently controlled.

Even in the process of controlling the oven in an intelligent way, the user usually only sees the food recognition results of the oven and the parameter settings provided by judgment at the beginning. Once the cooking starts, the only data that the oven feeds back to the user is: the real-time picture of the camera, the temperature change in the oven and the remaining time. However, through these parameters, the average user cannot distinguish and know the maturity of the food and what the intelligent control process of the oven is doing, so the intelligent control is a black box for the user, and it is for this reason that the user will be aware of the real intelligence of the intelligent There are doubts about the pseudo, and the experience is not very good.

SUMMARY OF THE INVENTION

An embodiment of the present invention provides a method for displaying a cooking state of a cooking appliance, including: presetting N cooking nodes and N cooking node identification models of food to be cooked at different time points in a cooking process, wherein the cooking nodes identify The models respectively include the standard cooking state information of the corresponding cooking nodes, and the N is a positive integer greater than or equal to 1; obtain cooking instructions of the food, and cook the food according to the received cooking instructions; obtain the actual cooking state information of the cooking nodes; Compare and identify the acquired actual cooking state information with the standard cooking state information of the corresponding cooking node through the cooking node identification model; send the identification result corresponding to the at least one cooking node to the user terminal interface or the cooking utensil interface for display to the user, The identification result includes at least normal cooking state information or abnormal cooking state information.

Using this embodiment, the cooking node identification models of different cooking nodes in a cooking process are used to monitor the cooking state of the cooked food and perform intelligent intervention and control, and then display the intelligent control process to the user according to the identification result, so that the user can The intelligent control process of the cooking appliance can be intuitively felt, and the user experience can be improved.

Optionally, the method further includes displaying the identification result corresponding to the cooking node to the user in the form of a graphic mark according to the cooking progress. Therefore, the user can more intuitively understand how the intelligent identification of the cooking appliance is compared and judged, and how to control it.

Optionally, the method further includes: acquiring a control signal for a user to operate the graphic mark; displaying the cooking status information of the cooking node corresponding to the graphic mark through a user terminal interface or a cooking utensil interface according to the control signal, wherein the The cooking state information includes whether the current cooking state of the cooking node is a normal cooking state or an abnormal cooking state. Therefore, the interaction with the user can be realized through the display unit, and the cooking status of the corresponding cooking node can be viewed.

Optionally, when the current cooking state of the cooking node is an abnormal cooking state, a control parameter information adjusted during the cooking process is simultaneously displayed through the user terminal interface or the cooking utensil interface according to the control signal. On the one hand, during the cooking period, monitoring the cooking status of the cooked food at the preset cooking nodes can ensure timely intervention in the cooking process at key cooking nodes, timely adjustment of cooking parameters, and timely correction when the cooking status deviates from expectations, thereby making the food mature. On the other hand, the intelligent intervention process can be displayed to the user through the display unit, so as to improve the user's experience of the intelligent control process.

Optionally, the adjusted control parameter information includes automatically adjusted control parameter information of the cooking appliance.

For example, the adjusted control parameter information includes at least one of the following: cooking time, cooking temperature, and cooking power.

Optionally, the standard cooking state information includes a cooking state standard image corresponding to a cooking node of the food to be cooked in a cooking process; the actual cooking state information includes an actual cooking state image corresponding to the cooking node of the food to be cooked; the The cooking state information of the cooking node corresponding to the graphic mark includes: an actual cooking state image of the food to be cooked corresponding to the cooking node and a cooking state standard image corresponding to the cooking node. The real-time image and the corresponding standard image are displayed on the display device, so that the user can intuitively observe the current cooking state of the food and whether it has reached the expected cooking state, and the use experience is better.

Further, the image marks corresponding to the different recognition results are different, so that the user can observe different cooking state information of the cooking appliance at the cooking node through the image marks.

Optionally, the abnormal cooking state information includes at least one of the following: the actual cooking state does not reach the standard cooking state corresponding to the cooking node, and the actual cooking state exceeds the standard cooking state corresponding to the cooking node.

Optionally, before obtaining the cooking instruction of the food, the method further includes: presetting a food identification model for food identification; identifying the food through the preset food identification model, and obtaining the corresponding cooking instruction based on the identified food. The food type is identified through image recognition, and the monitoring cooking state model corresponding to the food type is obtained, so as to realize the automatic identification of the food and monitor the cooking process of the food, so that the cooking appliance can work intelligently.

Optionally, the method further includes: determining N cooking node identification models in a cooking process corresponding to the food according to the identification result of the food.

Optionally, the standard cooking state information includes a standard cooking state image of the food; the actual cooking state information includes an actual cooking state image of the food.

An embodiment of the present invention further provides a cooking appliance, comprising a display unit, an information acquisition unit and a control unit connected to both, the information acquisition unit is configured to acquire actual cooking state information of the food to be cooked during the cooking process; the The control unit is configured to execute the method described in any one of the foregoing; the display unit is configured to receive the recognition result sent by the control unit, and display the recognition result to the user.

Optionally, the control unit is further configured to adjust cooking control parameters of the cooking appliance according to the identification result.

Optionally, the control unit is further configured to control the display unit to display the adjusted cooking control parameters.

Optionally, the control unit is wirelessly connected to the display unit and the information acquisition unit.

Optionally, the information acquisition unit includes a camera.

An embodiment of the present invention further provides a cooking appliance control system, including a cooking appliance and a server in communication with the cooking appliance, where the cooking appliance is used to acquire actual cooking state information of the food to be cooked during the cooking process; the server is configured to execute the aforementioned The method of any one; the cooking appliance is further configured to receive the identification result sent by the server, and display the identification result to the user through the display unit.

Optionally, the cooking appliance is further configured to adjust the cooking control parameters of the food it cooks according to the identification result.

Optionally, the cooking appliance is further configured to display the adjusted cooking control parameters.

Embodiments of the present invention further provide a computer-readable storage medium, where the computer-readable storage medium is a non-volatile storage medium or a non-transitory storage medium, on which a computer program is stored, and the computer program is executed by a processor perform the steps of the above method.

Description of drawings

1 is a schematic diagram of a cooking utensil according to an embodiment of the present invention;

Fig. 2 is the frame schematic diagram of a kind of cooking utensil according to the embodiment of the present invention;

3 is a flow chart showing the cooking state of the cooking appliance according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of the display mode of the cooking state of FIG. 2 according to an embodiment of the present invention;

Fig. 5 is a kind of presentation mode schematic diagram of Fig. 4;

FIG. 6 is a schematic diagram of another display mode of FIG. 4;

Fig. 7 is a kind of display interface schematic diagram of the display unit in Fig. 2;

8 is a schematic structural diagram of a cooking appliance control system according to an embodiment of the present invention;

Fig. 9 is the working flow chart of a kind of cooking appliance control system of Fig. 8;

In the attached picture:

1-cooking appliance; 10-body; 101-input and output module; 1011-display unit; 20-cavity; 11-control unit; 12-heating module; 13-information acquisition unit; 14-tray; 2-server.

Detailed ways

When users use smart cooking devices, they hope that cooking devices such as ovens can be fully automated to reduce user intervention, but at the same time they are very worried that the cooking results produced by smart control are not what they expected, and hope to get appropriate information feedback, so as to achieve both Monitored the automatic cooking of the oven and got satisfactory cooking results again.

In the existing method, the user can only see the recognition result of the oven on the food at the beginning, and the parameter settings provided by the oven according to the recognition result. Once the cooking starts, the data fed back to the user by the oven may only be the real-time picture of the camera, the temperature change in the oven and the remaining time.

However, through these parameters, ordinary users cannot judge and know the maturity state of the food during the cooking process, and what the intelligent control of the oven is doing, so the intelligent control process is a black box for the user, and it is for this reason that the user will There are doubts about the authenticity of intelligence, and the experience is not very good.

Embodiments of the present invention provide a method for displaying the cooking state of a cooking utensil, a display device for the cooking utensil, a cooking utensil and a control system thereof. It is displayed to the user in an intuitive way, so that the user can understand how the intelligent control of the cooking equipment works and what it has done to accurately control the cooking process, so as to intuitively feel the intelligence and commercial value of the cooking equipment, and improve the use of the cooking equipment. experience.

In order to make the above objects, features and advantages of the present invention more clearly understood, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

1 and 2 are schematic diagrams of a cooking utensil according to an embodiment of the present invention; FIG. 3 is a flowchart of a method for displaying a cooking state of a cooking utensil according to an embodiment of the present invention. The cooking utensil 1 shown in FIGS. 1 and 2 can execute the method shown in FIG. 3 to monitor the cooking status of the food at different cooking nodes during cooking, and dynamically and intuitively display the cooking utensil to the user according to the recognition result. work process.

Specifically, referring to FIG. 1 , the cooking appliance 1 in this embodiment may be an oven, which may include: a main body 10 , and a cavity 20 disposed in the main body 10 , and the cavity 20 is used to place the food to be cooked. For example, the cooking appliance 1 may have a door that can open or close the cavity 20. When the door is opened, the cavity 20 is exposed for the user to take or prevent food from being cooked; when the door is closed, the cavity 10 is closed, and the Cooking operations such as heating, baking, etc. are performed on the food being cooked.

The cooking appliance 1 may further include an input/output module 101 , and the operation state of the cooking appliance 1 may be adjusted by operating the input/output module 101 ; cooking status information may also be displayed through the input/output module 101 . The operating state of the cooking appliance 1 may include heating power, heating direction, heating duration, steam delivery amount, steam delivery direction, and the like. The adjustment of these operating states can be achieved by adjusting the operating states of specific functional modules in the cooking appliance 1 .

Further, the cooking appliance 1 may further include a control unit 11 for adjusting the operating state of the corresponding functional module according to the instruction fed back by the input and output module 101, so that the operating state of the cooking appliance 1 conforms to the user's instruction; the control unit 11 can also input The signal or instruction controls the output mode of the input and output module 101 , such as the screen display content or display mode.

For example, the cooking appliance 1 may include a heating module 12 for heating the food 2 to be cooked. The cooking appliance 1 may include a plurality of heating modules 12, and the plurality of heating modules 12 are distributed in different regions of the cooking appliance 1 to heat the cavity 20 from different angles so that the cooked food 2 is heated as uniformly as possible. The control unit 11 can independently adjust the heating power of each heating module 12 to adjust the amount of heat radiated by each heating module 12 into the cavity 20 . The control unit 11 can also independently adjust the heating direction of each heating module 12 to adjust the radiation angle of the heat radiated by each heating module 12 into the cavity 20 . The control unit 11 can also adjust the heating time period for the specific heating module 12 to operate at a specific heating power, so as to heat the food to a desired effect.

For another example, the cooking appliance 1 may include a spray module (not shown) for delivering water vapor into the cavity 20 to adjust the humidity in the cavity 20 . By adjusting the humidity in the cavity 20, the surface humidity of the cooked food can be adjusted, so that the water content of the cooked food is moderate, and the surface of the cooked food can be prevented from being heated too dry or too wet. The cooking utensil 1 may include a plurality of spray modules, and the plurality of spray modules are dispersedly arranged in different areas of the cooking utensil 1 to transport water vapor into the cavity 20 from different angles, so that the surface of the cooked food is humidified Balanced distribution. The control unit 11 can independently adjust the steam delivery amount of each spray module. The control unit 11 can also independently adjust the steam delivery direction of each spray module. The control unit 11 can also adjust the spraying time for a specific spraying module to run with a specific steam delivery amount.

It should be pointed out that the input and output device 101 in FIG. 1 includes an input device that realizes an input function and a display device that realizes an output function. The input device and the display device can be integrated, for example, a touch display panel with touch function, which is used to realize data input and image information display; or they can be separated, and each realizes its own function, for example, the input device can It is similar to a knob adjustment key, and can also be in other forms, such as a touch screen, a voice control module, etc., and the display device can be a display screen, etc.

The display device may be provided on the cooking appliance 1 , or may be separated from or detachably connected to the cooking appliance 1 .

In this embodiment, the display device may include a display unit 1011 and a control unit 11 connected thereto, wherein the control unit 11 may be configured to display a progress pattern reflecting the current cooking progress of the cooking appliance 1 through the display unit 1011 . Thus, the cooking status of the cooking appliance 1 at different cooking nodes is displayed to the user in a visual manner, including real-time cooking status information and intervention measure information of the cooking appliance 1 .

In a specific embodiment, the control unit 11 connected to the display unit 1011 may be a control module of the cooking appliance itself, through which the control of the cooking appliance 1 and the control of the display unit 1011 are implemented.

Further, the control unit 11 may execute the method shown in FIG. 3 to monitor the cooking state of the food to be cooked, and display the control parameters or intervention behavior of the cooking appliance 1 during the cooking process through the display unit 1011 according to the identification result. For example, the control unit 11 may include or be externally connected to a memory (not shown), the memory stores a computer program, and the computer program executes the steps of the method shown in FIG. 3 when the computer program is executed by the processor.

It should be pointed out that FIG. 1 only exemplarily shows the possible setting positions of the control unit 11 in the cooking appliance 1 , and the specific setting positions of the control unit 11 can be adjusted as required in practical applications. In a variant, the control unit 11 may be externally provided to the cooking appliance 1 (eg, the server 2 , etc.), the cooking appliance 1 has a communication module (not shown), and the control unit 11 communicates with the communication module to send control to the cooking appliance 1 . The instruction, the control instruction is used to control the operating state of the cooking appliance 1 .

Further, the cooking appliance 1 may include an information acquisition unit 13, which is arranged in the cavity 20 or the door to collect the actual cooking state information of the food from at least one angle, and the control unit 11 communicates with the information acquisition unit 13 to The data collected by the information obtaining unit 13 is obtained.

For example, the information acquisition unit 13 may be a camera device, which is disposed on the top of the cavity 20 and covers at least the tray 14 in a bird's-eye view. Multiple camera devices may be provided to photograph the cooked food 2 from different angles.

For example, the camera device may also be arranged inside the door, and the shooting range at least includes the area where the food 2 to be cooked is located.

Further, the cooking appliance 1 may include a temperature detection device (not shown) for detecting the temperature of the surface of the food, the interior of the food, the interior of the body, and the like.

For example, a temperature sensor (not shown in the figure) may be provided in the cavity body 20 to collect (not shown in the figure) the temperature in the cavity body 20 . For another example, the tray 14 may be provided with a temperature sensor or probe (not shown) to collect the surface temperature or the internal temperature of the cooked food 2 .

In a specific embodiment, referring to FIG. 3 , the method for displaying the cooking state of the cooking appliance 1 in this embodiment may include the following steps:

Step S100, preset N cooking nodes and N cooking node identification models of the food to be cooked at different time points in a cooking process, wherein the cooking node identification models respectively include standard cooking state information corresponding to the cooking nodes, and the N cooking node identification models is a positive integer greater than or equal to 1;

Step S102, obtain the cooking instruction of the food, and cook the food according to the received cooking instruction;

Step S104, obtaining the actual cooking state information of the cooking node;

Step S106, compare and identify the obtained actual cooking state information and the standard cooking state information of the corresponding cooking node through the cooking node identification model;

Step S108, sending the identification result corresponding to the at least one cooking node to the user terminal interface or the cooking appliance interface for display to the user, wherein the identification result at least includes normal cooking state information or abnormal cooking state information. The cooking utensil interface here can be understood as a display device or a display unit of the cooking utensil; the user terminal interface can be a mobile terminal or the like wirelessly connected to the cooking utensil.

In this embodiment, generally a cooking method of a food corresponds to at least one cooking program, and the cooking program may include different cooking nodes in a cooking process, and the cooking nodes are used to monitor the cooking process of the food in different time periods during the cooking process. Ripe condition or state of cooking. Use the cooking node identification model of different cooking nodes in a cooking process to monitor the cooking state of the cooked food and perform intelligent intervention and control, and then display the intelligent control process to the user according to the identification result, so that the user can intuitively feel To the intelligent control process of cooking utensils, improve the user experience.

Specifically, when preparing to start cooking, the prepared food is put into the cooking appliance 1 . When the door of the cooking appliance 1 is closed, the information acquisition unit 13 starts to work, and collects the captured images in real time; or when the user sets cooking parameters such as heating time, heating temperature, etc. and starts cooking, the information acquisition unit 13 starts to work.

The information acquisition unit 13 may store the collected images in the main memory or the memory sent to the remote server. The control unit 11 monitors the cooking state of the food according to the collected images, uses the preset cooking node identification model to identify the actual cooking state information of the cooking node, and sends the identification result corresponding to the cooking node to the user terminal interface or the display unit of the cooking utensil for displaying. displayed to the user.

In one embodiment, the cooking appliance 1 may adjust the cooking parameters according to the identification result, and display the adjusted parameters to the user through the display unit 1011 . The display mode can be displayed at the end of a cooking process, or displayed during the cooking process. Thus, the cooking process is intelligently monitored, and the cooking parameters are adjusted in time when abnormal cooking is found, and the intelligent cooking control process is intuitively displayed to the user.

The cooking node identification model may be pre-stored in the memory, and the model includes standard cooking state information corresponding to the cooking node. For example, the standard cooking state information may be standard images of food cooking states corresponding to multiple cooking nodes. The standard image can be understood as the state the food should reach at the cooking node, and may include color parameters, shape parameters, and the like for characterizing the state of the food. This standard image is obtained by training on a large amount of cooking experiment data.

In a specific implementation, different cooking nodes correspond to different standard images.

In a specific implementation, the cooking node identification model is in one-to-one correspondence with the type of food.

For example, the memory stores a cooking node identification model A corresponding to cooking steak, a cooking node identification model B corresponding to cooking sweet potatoes, and the like.

For another example, a steak cooking program includes 3 cooking nodes, and the corresponding model A includes 3 cooking node identification sub-models A1, A2, and A3. Each of the sub-models respectively includes standard images of steaks corresponding to cooking nodes. During the process of cooking steak, the real-time cooking status images and corresponding standard images of the three cooking nodes can be monitored and compared, and the cooking parameters can be adjusted according to the recognition results and the results can be displayed to the user. The identification result here may include information that the steak is in a normal cooking state at one of the cooking nodes, or may be information that the steak is in an abnormal cooking state.

It should be noted that the above descriptions are only examples. In practical applications, cooking node identification models corresponding to various food types can be set in the memory, so as to expand the range of recipes that the cooking appliance 1 can cook intelligently.

In a specific embodiment, the display mode of the display device of the cooking appliance 1 may be that, under the control of the control unit 11 , the identification results corresponding to the cooking nodes are displayed to the user in the form of graphical marks according to the cooking progress.

In one embodiment, the control unit 1 may control the display unit 1011 to display a progress pattern reflecting a complete cooking process, wherein the progress pattern includes a plurality of cooking nodes spaced apart from each other in time, and each of the cooking nodes It represents the different cooking state information of the cooked food in a cooking process, and each cooking node is visually distinguished. The scene may be the display mode of the display unit after cooking or during cooking.

Preferably, the control unit 1 can control the display unit 1011 to display a progress pattern reflecting the current cooking progress, wherein the progress pattern includes a plurality of cooking nodes spaced apart from each other in time, and each of the cooking nodes represents that the food to be cooked is in one Different cooking status information during the cooking process, and each cooking node is visually distinguished.

For example, the progress pattern may include a bar pattern, and the current cooking progress extends over time along the bar pattern in the form of light brightness or color, so that the cooking progress of the cooking appliance can be intuitively known through the change of light or color.

For another example, the progress pattern may include a background pattern representing the complete cooking progress in a cooking process, and the current cooking progress gradually covers or replaces the background pattern over time in the manner of light brightness or color distinguished from the background pattern.

Further, the cooking node may be located on the background pattern to present the key nodes of the cooking process in a visual manner, so as to facilitate the interactive operation of the cooking device or the display device.

Through the setting of the aforementioned display device, in the intelligent cooking process of the cooking utensil, the user can intuitively feel the maturity of the cooked food, and what role the artificial intelligence brought by the image recognition technology plays in the whole cooking process, What controls are made and how they work. Thereby, the dynamic identification process of the cooking appliance 1 is displayed to the user in the aforementioned manner, so as to improve the user's experience in using the technology and the degree of trust in the technology and the happiness of success.

For example, in Figure 4, a complete cooking process is presented in the form of a time axis through the display unit, on which key status points, that is, cooking nodes, can be set. For example, the three cooking steps of cooking steak are presented through bubble graphics node.

In addition, the time information of the node can also be displayed on the corresponding node. For example, the first node in Figure 4 represents the cooking state recognition result at 10 minutes and 30 seconds.

Further, bubble images of different colors can be used to indicate whether the recognition result of the current cooking node is a normal cooking state or an abnormal cooking state. In Figure 4, one recognition result is represented by black filled bubbles, and another recognition result is represented by blank bubbles. This is just an exemplary illustration, and different recognition results can be distinguished in different ways in practical application.

Further, the user can view the identification result of the corresponding node by operating the graphic mark, such as clicking on the bubble graphic in the display unit.

In a specific embodiment, referring to FIG. 5 and FIG. 6 , the user can click on the image mark that he wants to view on the display unit 1011 , such as a bubble mark, and the cooking appliance 1 can obtain the control signal for the user to operate the graphic mark through the control unit 11 . ; and display the cooking state information of the cooking node corresponding to the graphic mark through the user terminal interface or the cooking utensil interface according to the control signal, wherein the cooking state information includes that the current cooking state of the cooking node is normal cooking state or abnormal cooking state. In this way, the interaction with the user can be realized through the display unit, and then the cooking status of the corresponding cooking node can be viewed.

Preferably, the control unit 11 is further configured to respond to a user operation only after the current cooking progress reaches or exceeds the cooking node, and display the cooking state information of the corresponding cooking node on the display unit 1011 based on the operation. Because the cooking nodes represent different cooking state information of the food to be cooked during a cooking process, but the current cooking progress has not reached a certain cooking node, the cooking appliance 1 or the control unit 11 has not intervened, adjusted or identified the cooking process, The corresponding cooking node has no cooking status information available for the user to view. Therefore, only after the current cooking progress reaches or exceeds the cooking node, the user can operate the corresponding cooking node and obtain a response, so as to obtain the cooking status information through the display unit.

Further, the cooking state information of the cooking node corresponding to the graphic mark may include: the actual cooking state image of the food to be cooked at the cooking node and the cooking state standard image corresponding to the cooking node, so as to visually observe the cooking state of the node. Whether the actual cooking progress is as expected.

Further, when the current cooking state of the cooking node is an abnormal cooking state, the control parameter information adjusted during the cooking process is simultaneously displayed through the user terminal interface or the cooking appliance interface according to the control signal, so as to visually observe the cooking appliance. 1 Intelligent intervention measures for the node, so that the cooking results are as expected as possible.

For example, as shown in FIG. 5 , when the user clicks on the first bubble graph in the figure, that is, the first cooking node, the display unit presents the screen as shown on the right side of the figure to the user. The picture includes standard cooking status images and actual cooking status images, and the cooking time is increased by 10 seconds. The presented information indicates the comparison between the actual cooking state of the steak and the standard cooking state at the current cooking node, that is, the cooking state is abnormal. At the same time, the cooking utensil adjusts the cooking time according to the comparison, and passes the adjusted situation through the The display unit is presented to the user.

For another example, as shown in FIG. 6 , when the user clicks the third bubble graphic in the figure, that is, the third cooking node, the display unit presents the screen as shown on the right side of the figure to the user. The picture includes the standard cooking state image and the actual cooking state image, and the current cooking state is the standard state. The presented information indicates that at the current cooking node, the actual cooking state of the steak is equivalent to the standard cooking state, which conforms to the cooking state that the current cooking node should achieve, that is, the normal cooking state. Therefore, "the current cooking state is the standard state" is displayed directly through the display unit.

In a common embodiment, the abnormal cooking state information includes at least one of the following: the actual cooking state does not reach the standard cooking state corresponding to the cooking node, and the actual cooking state exceeds the standard cooking state corresponding to the cooking node.

For example, when the abnormal cooking state is that the actual cooking state does not reach the standard cooking state corresponding to the cooking node, the cooking utensil control increases the control parameters, which can increase at least one of the cooking time, cooking temperature, and cooking power.

When the abnormal cooking state is that the actual cooking state exceeds the standard cooking state corresponding to the cooking node, the cooking utensil control reduces the control parameters, which can reduce at least one of the cooking time, cooking temperature, and cooking power.

In one embodiment, the aforementioned adjusted control parameter information includes control parameter information automatically adjusted by the cooking appliance, and the corresponding relationship between the intelligent recognition result of the cooking appliance 1 and the control parameter information can be set in a preset manner, so that the cooking appliance 1 The corresponding control parameter information is automatically obtained according to the identification result.

For example, when cooking a steak by using the cooking appliance 1, the cooking taste selected by the user is 7 minutes, and the cooking time is estimated to be 8 minutes. During the cooking process, the control unit 11 monitors that at the third cooking node, such as the sixth minute of the cooking time, the comparison result between the real-time image collected by the information acquisition unit 13 and the standard image is that the current cooking state of the steak has exceeded the corresponding standard The cooking state of the steak in the image. If you continue to heat according to the preset 8 minutes, the final steak will probably be older or less than expected. Therefore, the control unit controls to reduce the total heating time, for example, by 20 seconds, that is, to adjust the originally planned heating time of 8 minutes to heating for 7 minutes and 40 seconds. This fine-tuning is a great way to avoid overcooking, which results in the desired cooking result.

In a specific implementation, N cooking nodes at different time points of the food to be cooked in a cooking process may be preset, and the cooking nodes are obtained according to the cooking experiment data of different foods. Through experiments, it can be seen that most ingredients have color and shape changes during the cooking process, which can be used to judge the cooking state of food. Therefore, the whole cooking process can be divided into different state points, ie, cooking nodes, according to the characteristics of the food. Different food status points will also have differences. For example, we found 3 status points for steak through experiments, and 2 status points for chicken wings. These status points will become important reference points for cooking utensils to judge the cooking status of food.

During cooking, the cooking status of the cooking food is identified at the preset cooking nodes, which can ensure timely intervention in the cooking process at key cooking nodes, timely adjustment of cooking parameters, and timely correction when the cooking status deviates from expectations. On the one hand, the cooking results of the food meet expectations; on the other hand, the method of adding the cooking state to the time progress axis shows the important nodes of artificial intelligence intervention to the user, so that the user can understand what the artificial intelligence has done for cooking, intuitively Perceive the intelligent control process.

In one embodiment, the real-time image of the food under the current cooking node and its corresponding standard image may be displayed through the display unit 1011 to present the cooking state of the food under the current cooking node.

For example, in the cooking process, when reaching a certain cooking node, the control unit 11 may call the actual cooking state image and the cooking state standard image of the node stored therein and present them to the user through the display unit 1011 . Alternatively, as described above, when the user clicks on the graphic mark corresponding to the cooking node, the control unit 11 may call the actual cooking state image and the standard cooking state image of the node stored therein and present them to the user through the display unit. In this way, not only the cooking equipment can intelligently adjust the cooking process, but the user can also intuitively see the cooking status and cooking progress of the food, as well as the intervention process of the cooking utensils on the cooking parameters, and the user experience is better.

In one embodiment, the control unit 11 may further control the display unit 1011 to display, through the display unit 1011, a first area including an image of the cooked food displayed in real time, and a second area including the progress pattern. For example, as shown in FIG. 7 , a display interface of the display unit 1011 includes a real-time cooking state image of the cooked food, ie, steak, and an intelligent identification pattern of the cooking process presented by a progress bar. The display interface may also include cooking control parameter information and the like of the cooking appliance.

In one variation, the method may also adjust cooking parameters in conjunction with the real-time internal temperature of the food. The real-time internal temperature of the food can be acquired through a probe or other sensors, and the cooking appliance 1 can be controlled according to the real-time internal temperature and the current cooking state of the food.

Specifically, when the real-time internal temperature is lower than the standard temperature, the cooking time or the cooking temperature is increased; otherwise, the cooking time or the cooking temperature is decreased. On the basis of image recognition and monitoring of the cooking state, combined with the internal temperature of the food to control the cooking utensil 1, the cooking parameters can be better controlled to obtain the expected cooking effect of the food.

For example, during cooking, the internal temperature of the food does not reach the expected temperature at a certain cooking node, which may lead to the problem that the food is not cooked properly. Adjust the cooking time and cooking temperature by monitoring the internal temperature in real time. On the contrary, when the internal temperature of the food is too high at this cooking node, it may cause the food to be overcooked, and the overcooking can be avoided by intervening in advance by monitoring the internal temperature in real time.

For another example, when cooking some food (such as steak), the difference in the image between 7 and 9 is very small; or the appearance, color, etc. of some food do not change much during a certain cooking process, which cannot be passed through the image. Effective identification allows better control of cooking results by combining with internal temperature.

In a specific implementation, food identification can be performed before the method and a cooking node identification model can be automatically matched based on the food identification results. Specifically, a food recognition model for food recognition is preset, an image of cooking food is acquired, the image is recognized by the food recognition model, and a corresponding cooking instruction is acquired based on the recognized food. Further, N cooking node identification models in a cooking process corresponding to the food are determined according to the food identification result.

In a variant, the cooking appliance 1 may be provided with multiple information acquisition units 13 for acquiring images of cooked food and identification results from different angles, and determining an identification result based on priority to improve the accuracy of food identification.

In a specific implementation, the method may further determine at the end of cooking whether it has matured or has reached expectations. Specifically, when the cooking process is nearing the end, obtain the image of the cooking state of the food at the last cooking node; determine whether the food under the cooking node is mature; if so, control the cooking appliance to stop working; or if not, increase the cooking time or cooking temperature to control cooking utensils. Therefore, it is avoided that the food is not mature after the cooking is finished, or the food is cooked and continues to be cooked, which wastes resources and destroys the taste of the food.

A specific embodiment of the present invention also discloses a control system for a cooking appliance 1, including a cooking appliance 1 and a server 2 that can interact with each other, wherein the control unit 11 can also be provided on the server 2, and the control unit 11 is configured to execute The method described above in FIG. 3 . Specifically, the control unit 11 is connected in communication with the cooking appliance 1 , and the cooking appliance 1 is configured to receive the identification result sent by the server 2 and display the identification result to the user through the display unit 1011 . In this way, the control unit 11 is arranged on the server 2, and data processing such as identification is performed on the server 2. On the one hand, it is convenient for the training, learning and updating of data such as models, and improves the data and accuracy of the processed data; on the one hand, it reduces the cooking utensil itself. the complexity. In this way, the intelligence of controlling the cooking appliance is improved.

The cooking appliance 1 can work according to the cooking control parameters sent by the control unit 11 ; specifically, the cooking appliance 1 can adjust the cooking control parameters of the food it cooks according to the aforementioned identification result.

Further, the cooking appliance 1 is also used to display the adjusted cooking control parameters. Specifically, the cooking appliance controls the display unit 1011 through the control unit 11 to display its adjusted control parameters, intuitively showing the intelligent control process of the cooking appliance to the user, and improving the user experience.

The specific implementation of the control system will be described in detail below with reference to FIG. 9 , taking an intelligent oven as an example.

Start the oven, obtain the video information of the cooked food in real time, and upload the video information to the server in the form of video stream. The server identifies the cooked food through the food identification model, and retrieves corresponding cooking parameters according to the cooked food. The server sends the cooking parameters to the oven in the form of cooking instructions, and the oven displays the instruction information through the display unit.

The user confirms the displayed instructions and feeds back the user response information to the oven to instruct the oven to start cooking.

The oven starts cooking, and during the cooking process, the oven uploads the video stream of the food to be cooked to the server in real time through the camera device.

The server receives the video stream, and identifies the cooking state of the corresponding cooking node through a preset cooking node identification model.

In FIG. 9 , if the cooking node 1 identification model identifies the node as an abnormal node, the intervention measures for the abnormal node, ie, increase or decrease the cooking time, and the real-time cooking status image of the cooking node are sent to the oven.

The oven receives the recognition result, and controls the display unit to display the recognition result, wherein the display of the recognition result can be in the form of graphic marks, including the actual cooking state image and the standard image, and the oven's intervention measures for this node, such as increase or decrease Parameter information such as cooking time, as shown in Figures 4 and 5.

If the recognition model of cooking node 1 recognizes that the node is a normal node, and sends the recognition result to the oven, and controls the display unit to display the recognition result, the displayed content includes the actual cooking state image and the standard image, as shown in Figures 4 and 6.

A cooking node of a food in a cooking process includes a plurality of nodes, and each node is correspondingly preset with a cooking node identification model. The identification process and display manner of other cooking nodes, such as cooking nodes 2 to N, are similar to the process of cooking node 1, and are not repeated here.

When the cooking is over, a cooking end instruction is sent to the oven, and the cooking end state is displayed on the display unit.

An embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium is a non-volatile storage medium or a non-transitory storage medium, on which a computer program is stored, and the computer program is executed by a processor The steps of the control method provided by any of the foregoing embodiments are executed at runtime.

Although specific embodiments have been described above, these embodiments are not intended to limit the scope of the disclosure, even if only a single embodiment is described with respect to specific features. The feature examples provided in this disclosure are intended to be illustrative, not restrictive, unless stated otherwise. In a specific implementation, the technical features of one or more of the dependent claims may be combined with the technical features of the independent claims, and may be combined in any suitable way and not only by the specific combinations recited in the claims Features from the corresponding independent claims.

Although the present invention is disclosed above, the present invention is not limited thereto. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention should be based on the scope defined by the claims.

Claims (20)

1. A method for displaying the cooking state of a cooking appliance, wherein the method comprises: Preset N cooking nodes and N cooking node identification models of the food to be cooked at different time points in a cooking process, wherein the cooking node identification models respectively include standard cooking state information of the corresponding cooking nodes, and N is greater than or equal to a positive integer of 1; Obtain the cooking instructions of the food, and cook the food according to the received cooking instructions; Get the actual cooking status information of the cooking node; Compare and identify the acquired actual cooking state information with the standard cooking state information of the corresponding cooking node through the cooking node identification model; The identification result corresponding to the at least one cooking node is sent to the user terminal interface or the cooking appliance interface for display to the user, wherein the identification result at least includes normal cooking state information or abnormal cooking state information. 2 . The method according to claim 1 , wherein the sending the identification result corresponding to at least one cooking node to the user terminal interface or the cooking appliance interface for display to the user comprises: sending the identification result corresponding to the cooking node. 3 . Graphical markers are displayed to the user according to the cooking progress. 3. The method of claim 2, wherein the method further comprises: obtaining a control signal for the user to operate the graphic mark; The cooking state information of the cooking node corresponding to the graphic mark is displayed through the user terminal interface or the cooking appliance interface according to the control signal, wherein the cooking state information includes whether the current cooking state of the cooking node is a normal cooking state or an abnormal cooking state. 4 . The method according to claim 3 , wherein when the current cooking state of the cooking node is an abnormal cooking state, an adjustment during cooking is simultaneously displayed through a user terminal interface or a cooking appliance interface according to the control signal. 5 . control parameter information. 5. The method of claim 4, wherein the adjusted control parameter information comprises automatically adjusted control parameter information of the cooking appliance. 6. The method of claim 4, wherein the adjusted control parameter information includes at least one of the following: cooking time, cooking temperature, and cooking power. 7. The method according to claim 3, wherein the standard cooking state information comprises a cooking state standard image corresponding to a cooking node of the food to be cooked in a cooking process; the actual cooking state information comprises that the food to be cooked is The actual cooking state image corresponding to the cooking node; The cooking state information of the cooking node corresponding to the graphic mark includes: an actual cooking state image of the food to be cooked corresponding to the cooking node and a cooking state standard image corresponding to the cooking node. 8. The method of claim 2, wherein the image labels corresponding to the different recognition results are different. 9 . The method according to claim 1 , wherein the abnormal cooking state information comprises at least one of the following: the actual cooking state does not reach the standard cooking state corresponding to the cooking node, and the actual cooking state exceeds the standard cooking state corresponding to the cooking node. 10 . state. 10. The method according to claim 1, wherein before acquiring the cooking instructions of the food, it further comprises: presetting a food recognition model for food recognition; the food to get the corresponding cooking instructions. 11. The method of claim 10, further comprising: determining N cooking node identification models in a cooking process corresponding to the food according to the identification result of the food. 12. The method of claim 1, wherein the standard cooking state information includes a standard cooking state image of the food; and the actual cooking state information includes an actual cooking state image of the food. 13. A cooking appliance comprising a display unit, an information acquisition unit and a control unit connected to both, characterized in that: The information acquisition unit is configured to acquire actual cooking state information of the food to be cooked during the cooking process; the control unit is configured to perform the method of any of claims 1-12; The display unit is configured to receive the recognition result sent by the control unit, and display the recognition result to the user. 14. The cooking appliance of claim 13, wherein the control unit is further configured to adjust cooking control parameters of the cooking appliance according to the recognition result. 15. The cooking appliance of claim 14, wherein the control unit is further configured to control the display unit to display the adjusted cooking control parameters. 16. The cooking appliance of claim 13, wherein the control unit is wirelessly connected to the display unit and the information acquisition unit. 17. The cooking appliance of claim 13, wherein the information acquisition unit comprises a camera. 18. A cooking appliance control system, comprising a cooking appliance and a server in communication with the cooking appliance, wherein the cooking appliance is used to acquire actual cooking state information of food to be cooked during a cooking process; The server is configured to perform the method according to any one of claims 1-12; The cooking appliance is further configured to receive the identification result sent by the server, and display the identification result to the user through the display unit. 19 . The cooking appliance control system according to claim 18 , wherein the cooking appliance is further configured to adjust the cooking control parameters of the food it cooks according to the recognition result. 20 . 20. The cooking appliance control system according to claim 19, wherein the cooking appliance is further configured to display the adjusted cooking control parameters.

Images