CN112426060A - Control method, cooking appliance, server and readable storage medium - Google Patents

Control method, cooking appliance, server and readable storage medium Download PDF

Info

Publication number
CN112426060A
CN112426060A CN202011369263.1A CN202011369263A CN112426060A CN 112426060 A CN112426060 A CN 112426060A CN 202011369263 A CN202011369263 A CN 202011369263A CN 112426060 A CN112426060 A CN 112426060A
Authority
CN
China
Prior art keywords
information
cooking
cooking appliance
food material
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011369263.1A
Other languages
Chinese (zh)
Inventor
孙裕文
孙涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Midea Group Co Ltd
Guangdong Midea Kitchen Appliances Manufacturing Co Ltd
Original Assignee
Midea Group Co Ltd
Guangdong Midea Kitchen Appliances Manufacturing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Midea Group Co Ltd, Guangdong Midea Kitchen Appliances Manufacturing Co Ltd filed Critical Midea Group Co Ltd
Priority to CN202011369263.1A priority Critical patent/CN112426060A/en
Publication of CN112426060A publication Critical patent/CN112426060A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47JKITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
    • A47J37/00Baking; Roasting; Grilling; Frying
    • A47J37/06Roasters; Grills; Sandwich grills
    • A47J37/0623Small-size cooking ovens, i.e. defining an at least partially closed cooking cavity
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47JKITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
    • A47J37/00Baking; Roasting; Grilling; Frying
    • A47J37/06Roasters; Grills; Sandwich grills
    • A47J37/0623Small-size cooking ovens, i.e. defining an at least partially closed cooking cavity
    • A47J37/0664Accessories

Abstract

The invention provides a control method, a cooking appliance, a server and a readable storage medium. The control method comprises the following steps: determining category information and weight information of food materials according to food material images of the food materials in the cooking appliance; and determining cooking parameters corresponding to the food materials according to the category information and the weight information, and controlling the cooking appliance to work. Therefore, the cooking parameters suitable for food materials can be automatically matched, the optimal cooking effect is ensured, meanwhile, intelligent full-automatic cooking is realized, and the convenience of a cooking appliance is improved; and need not to set up weighing transducer, not only can obtain alone and eat material weight, avoid holding the container of eating the material and detect the error that causes the weight, can also simplify cooking utensil structure, reduce manufacturing cost is favorable to cooking utensil's miniaturization.

Description

Control method, cooking appliance, server and readable storage medium
Technical Field
The invention relates to the technical field of household appliance control, in particular to a control method of a cooking appliance, the cooking appliance, a server and a readable storage medium.
Background
In the correlation technique, through temperature probe measurement edible material temperature, when eating the inside temperature of material and reaching a definite value, last a period, guarantee to eat the material and bake maturity, but temperature probe only has an effect to bold meat, and most of baking and common barbecue can not be used, and the use scene limitation is great. Or through the camera discernment eat material category, cooperate weighing transducer to weigh and eat material weight, and then match out culinary art temperature and time, nevertheless weighing transducer can only weigh and eat material and the common weight of household utensils, and inconvenient independent extraction is eaten material weight, and the serious influence sets for the degree of accuracy of culinary art temperature and time, reduces the culinary art effect.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art or the related art.
To this end, a first aspect of the present invention is to propose a control method of a cooking appliance.
A second aspect of the present invention is to propose a cooking appliance.
A third aspect of the present invention is directed to a server.
A fourth aspect of the invention is directed to a readable storage medium.
In view of the above, according to a first aspect of the present invention, a method for controlling a cooking appliance is provided, including: determining category information and weight information of food materials according to food material images of the food materials in the cooking appliance; and determining cooking parameters corresponding to the food materials according to the category information and the weight information, and controlling the cooking appliance to work.
According to the control method of the cooking appliance, after the food materials are determined to be placed in the cooking cavity of the cooking appliance, the food material image of the food materials in the cooking appliance is used for identifying the category information of the food materials, and the weight information of the food materials is estimated according to the proportion of the food materials in the food material image. And searching a pre-stored database according to the category information and the weight information of the food materials, and acquiring cooking parameters corresponding to the category information and the weight information, wherein the cooking parameters comprise cooking temperature and cooking time. On one hand, the cooking parameters suitable for food materials can be automatically matched, the categories of the food materials are not limited, the key operation of a user is not needed, one-key cooking is realized, the optimal cooking effect is ensured, meanwhile, the intelligent full-automatic cooking is realized, the convenience of a cooking appliance is improved, and the operation is convenient and reliable; on the other hand, the food weight is detected by utilizing the image recognition target detection technology, a weight sensor is not required to be arranged, the food weight can be obtained independently, the error caused by the weight detection of a container for containing food materials is avoided, the structure of the cooking appliance can be simplified, the manufacturing cost is reduced, and the miniaturization of the cooking appliance is facilitated.
Specifically, the image recognition target detection technology includes at least one of: a Yolo (you Only Look one) model, a fast-RCNN model, a Mask-RCNN model, a ResNet (deep residual network) model.
It can be understood that the food material image can be a two-dimensional image or a three-dimensional image, the category information of the food material is identified through the two-dimensional image, the size information is identified through the three-dimensional image, and then the weight information of the food material is determined.
Further, image enhancement processing is carried out after the image is obtained, so that the image definition is improved, and accurate detection of the category information and the weight information is facilitated.
In addition, according to the control method of the cooking appliance in the above technical solution provided by the present invention, the following additional technical features may be further provided:
in the above technical solution, further, determining weight information of the food material according to the food material image of the food material in the cooking appliance specifically includes: identifying outline information of the food material in the food material image and position information of the food material in the cooking utensil; determining the volume information of the food material according to the contour information and the position information; acquiring density information of food materials; determining weight information based on the volume information and the density information.
According to the technical scheme, the outline of the food material is segmented by using a target segmentation algorithm, such as a Mask-RCNN model, so as to obtain the outline information of the food material, and meanwhile, the position information of the food material in the cooking appliance is analyzed by using a target detection algorithm, such as a Yolo model and a fast-RCNN model, by referring to a cooking cavity of the cooking appliance. The actual size information of the food materials is determined according to the contour information and the position information of the food materials, and the volume information of the food materials is calculated according to the size of the food materials. The method comprises the steps of obtaining density information of food materials, and calculating weight information of the corresponding food materials according to a formula of weight (m) to density (rho) multiplied by volume (V). Thereby can detect out alone through eating the material image and eat material weight, avoid holding the container of eating the material and detect the error that causes to weight for the edible material cooking temperature and the culinary art time of setting for are more accurate, need not to set up weighing transducer moreover, simplify cooking utensil structure, reduce cooking utensil's manufacturing cost, are favorable to reducing cooking utensil's occupation space.
Further, the number of the food materials placed in the cooking appliance can be accurately analyzed through the profile information of the food materials, if the number of the food materials is multiple, the volume information of each food material is determined respectively, and the total volume of the food materials can be obtained by accumulating the volume of each food material. Of course, for food materials with regular shapes, such as chicken wings and egg tarts, the volume of each food material is basically uniform, so that the volume information of all food materials does not need to be identified, and the total volume of the food materials can be obtained by multiplying the volume of each food material by the number of the food materials.
It can be understood that the density information of the food material can be obtained through data set by a user, and the corresponding density information can also be called in a database through the category information of the food material.
In any of the above technical solutions, further, determining the volume information of the food material according to the contour information and the position information specifically includes: determining the distance between the food material and a camera of the cooking appliance according to the position information; determining the size information of the food material according to the contour information and the distance; volume information is determined from the size information.
In the technical scheme, the distance between the food material and the camera of the cooking appliance is determined according to the position information of the food material in the cooking appliance, the proportion of the food material in the food material image is further determined, geometric calculation is carried out according to the proportion and the identified outline information of the food material, and the actual size information of the food material is obtained, wherein the size information comprises the length, the width, the height, the surface area and the like of the food material. The volume information of eating the material can be calculated according to the size information, and then the weight information of eating the material is calculated with density to utilize weight automatic matching to eat the required best cooking parameter of material culinary art, provide reliable foundation for follow-up control cooking utensil work, convenient and fast, simultaneously, need not the manual work and set up the relevant data of culinary art, for the user of no culinary art experience provides accurate culinary art parameter, reduce the culinary art degree of difficulty, improve culinary art efficiency and effect.
In any of the above technical solutions, further, the determining the weight information based on the category information includes a plurality of different categories according to the volume information and the density information, and specifically includes: determining the quantity of each type of food materials in different types of food materials according to the contour information and the type information; and determining weight information according to the corresponding quantity, volume information and density information of each type of food materials in different types of food materials.
In the technical scheme, for the condition that a plurality of different types of food materials exist in the cooking appliance, the number of each type of food material in the different types of food materials is determined according to the profile information and the category information of the food materials. And respectively calculating the weight information of each type of food material according to the corresponding quantity, volume information and density information of each type of food material in different types of food materials, and summing the weight information of each type of food material to obtain the total weight of all food materials in the cooking appliance. Therefore, the food materials of different types can be identified, the accuracy of food material weight detection is improved, the matched cooking parameters are more fit with the actual required cooking conditions of the food materials, and the cooking effect of the cooking appliance is ensured.
In any of the above technical solutions, further, determining the number of each of the different types of food materials according to the profile information and the category information specifically includes: determining a regression frame of each food material according to the contour information; determining the total amount of the food materials according to the number of the regression frames; and determining the quantity of each type of food materials in different types of food materials according to the total quantity and the category information.
In the technical scheme, the outline information of the food materials is obtained through an image detection technology, the regression frames of each food material in the outline information are determined, the total number of the food materials can be identified through the number of the regression frames, and then the total number of the food materials is divided according to the category information of the food materials, so that the number of each type of food materials in different categories of food materials can be obtained. The method is convenient for calculating the weight information of each type of food materials respectively, so that the relevant information of each type of food materials can be identified according to the correspondence, the accuracy of food material weight detection is improved, the matched cooking parameters are more fit with the actual required cooking conditions of the food materials, and the cooking effect of the cooking appliance is ensured.
In any of the above technical solutions, further, determining the category information of the food material according to the food material image of the food material in the cooking appliance specifically includes: identifying characteristic information of food materials in the food material image; determining the similarity between the characteristic information and the characteristics of the preset food materials; and determining category information according to the preset food material characteristics with the similarity greater than or equal to the similarity threshold.
In the technical scheme, the characteristic information of the food material in the food material image is identified by using a pattern recognition algorithm, such as a ResNet model, and the characteristic information of the food material is compared with the preset food material characteristics to obtain the similarity between the characteristic information and the preset food material characteristics, namely the probability of the category to which the food material belongs. If the similarity is greater than or equal to the preset similarity threshold, which indicates that the matching degree of the characteristic information and the preset food material characteristics is high, the category corresponding to the preset food material characteristics with the similarity greater than or equal to the preset similarity threshold is used as the category information of the food material. Therefore, the categories of the food materials can be accurately identified, different cooking parameters are adjusted according to different food materials, the cooking requirements of different categories and quantities of food materials are met, and the use experience of a user is improved.
In any of the above technical solutions, further, determining a cooking parameter corresponding to the food material, and controlling the cooking appliance to work, specifically includes: displaying and/or transmitting cooking parameters to a terminal associated with the cooking appliance; and controlling the cooking appliance to work according to the cooking parameters based on the confirmation instruction of the detected cooking parameters.
In the technical scheme, the cooking appliance can perform information interaction with the terminal, and when cooking is needed, the cooking parameters are automatically matched according to the category information and the weight information of food materials, the obtained cooking parameters are displayed, or the cooking parameters are sent to the user terminal, so that a user can timely and clearly know the set cooking parameters. If the confirmation instruction of the cooking parameters is detected, the user confirms to execute the cooking parameters, and then the cooking appliance is controlled to perform cooking work according to the current cooking parameters. And if the user is not satisfied with the current cooking parameters or the current cooking parameters are not matched with the current food materials, re-identifying the category and the weight of the food materials, adjusting the cooking parameters in time or manually adjusting the cooking parameters by the user, and controlling the cooking appliance to perform cooking work according to the adjusted cooking parameters. Thereby promoted cooking utensil's interpersonal interactive performance, the user can confirm and adjust the culinary art parameter, avoids the setting error of culinary art parameter, can control cooking utensil more nimble, has improved user's culinary art process's experience.
Specifically, the manner of information interaction between the cooking appliance and the terminal is not limited to infrared transmission, WIFI (wireless local area network) transmission, zigbee transmission, bluetooth transmission, or the like.
Specifically, the user can adjust the cooking parameters by operating an input key or a knob or the like arranged on the surface of the cooking appliance, and can also adjust the cooking parameters by using a terminal, such as an APP installed on the terminal.
In any of the above technical solutions, further, the method further includes: acquiring the working time of the cooking appliance; determining and displaying the remaining working time length according to the difference value between the cooking time length and the working time length in the cooking parameters; and controlling the cooking appliance to stop working and sending prompt information based on the working time length being greater than or equal to the cooking time length.
In this technical scheme, acquire cooking utensil's operating time length, cooking utensil is according to the length of operation of cooking parameter work promptly, calculates the difference of length of cooking time and operating time length in the cooking parameter, confirms and shows that it reaches the length of remaining operating time that the target state is eaten to the material to realize user's culinary art count-down, and the user of being convenient for understands the required time of culinary art directly perceived, is favorable to the user to plan the culinary art, thereby improves cooking efficiency, promotes user's use and experiences.
In addition, when the working time of the cooking appliance is longer than or equal to the cooking time, the cooking appliance is controlled to stop working and prompt information is sent to prompt the user that the cooking is finished. Therefore, whether the food materials are mature or not is judged without manual work, the food materials are automatically cooked according to the set cooking parameters, the observation time of a user is saved, great convenience is brought to the user, and the use experience of the user is greatly enhanced.
Specifically, the prompting mode includes at least one of the following: image, voice, text, video, light.
In any of the above technical solutions, further, before determining the category information and the weight information of the food material according to the food material image of the food material in the cooking appliance, the method further includes: acquiring a cavity image of a cooking appliance; identifying the bearing state of the cooking appliance according to the cavity image; and taking the cavity image as a food material image based on the fact that the cooking appliance is in a non-idle state.
In the technical scheme, the bearing condition inside the cavity of the cooking appliance is monitored according to the cavity image, if the cooking appliance is in a non-idle state, namely food materials are placed in the cooking appliance, the cavity image is used as a food material image, the category information and the weight information of the food materials are analyzed through the food material image, automatic matching of cooking parameters is achieved, the image processing load of the cooking appliance or a server is effectively reduced, and energy consumption is reduced.
Further, if cooking utensil is in idle state, explain that the user forgets to put into edible material, then send the warning suggestion, avoid the danger that cooking utensil idle running leads to ensured user's life and property safety, promoted cooking utensil security, avoided unnecessary consumption simultaneously, saved the resource, promoted user experience.
In any of the above technical solutions, further, acquiring a cavity image of the cooking appliance specifically includes: based on the door closing signal of detecting cooking utensil, acquire the cavity image.
In this technical scheme, cooking utensil is provided with the door body and closes the door and detects the sensor, and the detection sensor that closes the door is used for exporting the signal of closing the door. If the door closing signal is detected, the user executes the operation from opening the door body to closing the door body, and then the cavity image of the cooking appliance is obtained. Therefore, the invalid work of the camera device is avoided, the service life of the camera device is prolonged, and the energy consumption of the cooking utensil is reduced.
Specifically, the camera device can be controlled to acquire the current cavity image of the cooking appliance, or the cavity image is intercepted from the video recorded by the camera device.
According to a second aspect of the present invention, there is provided a cooking appliance comprising: a main body having a cooking cavity; the camera device is used for acquiring a cavity image of the cooking cavity; a memory storing a program or instructions; and a processor connected to the memory and the camera, and executing the program or the instructions to execute the method for controlling the cooking appliance according to the first aspect. Therefore, the cooking appliance has all the advantages of the control method of the cooking appliance provided by the first aspect.
Furthermore, the camera device comprises one or more groups of cameras, the cameras can acquire cavity images at multiple angles, accuracy of weight information and category information identification is improved, and reliable data are provided for follow-up matching of cooking parameters.
Specifically, the cooking appliance includes: and food heating equipment such as ovens, steam boxes, microwave ovens, electric cookers and the like.
In any of the above technical solutions, further, the method further includes: the door body is connected with the main body in an openable and closable manner; the camera device is arranged in the door body or the cooking cavity.
In this technical scheme, the door body can be opened and shut with the main part and be connected to open or seal the culinary art chamber, consider that the door body temperature is the lowest position of whole cavity temperature, in order to avoid the camera device high temperature and damage, can set up camera device in the door body, guarantee camera device temperature in safety range, the door body can prevent to cook steam or the oil stain of in-process production in addition and adhere to camera device, so that keep camera device's cleanliness, and then guarantee the definition of cavity image.
In any of the above technical solutions, further, a heat dissipation device is connected to the main body, and the heat dissipation device is used for performing heat dissipation processing on the image pickup device.
In this technical scheme, in order to avoid the heat that produces in the cooking utensil heating process or the camera device damage camera device that generates heat of long-time work, then install heat abstractor in the main part to carry out the cooling treatment to camera device, thereby avoid camera device high temperature and damage, effectively prolong camera device's life.
In particular, the heat sink may be an air-cooled structure.
According to a third aspect of the present invention, there is provided a server comprising: the communication assembly is used for receiving a cavity image of the cooking utensil; a memory storing a program or instructions; and the processor is connected with the memory and the communication component, and when the processor executes the program or the instructions, the processor executes the control method of the cooking appliance.
According to the technical scheme, the cooking appliance is used for displaying images of the cavity of the server through the communication module in the operation process. After receiving the cavity image, the server identifies the category information and the weight information of the food materials in the cavity image, determines appropriate cooking parameters according to the category information and the weight information, and sends a control instruction carrying the cooking parameters to the cooking appliance to enable the cooking appliance to work. On one hand, data analysis and processing are carried out through the cloud server, the speed and the accuracy of determining cooking parameters are improved, meanwhile, a database and a data analysis processing assembly are not required to be arranged in a cooking appliance which is interacted with the server, the running cost of the cooking appliance is reduced, miniaturization of the cooking appliance is facilitated, on the other hand, the cooking parameters suitable for food materials can be automatically matched, the category of the food materials is not limited, key operation of a user is not required, one-key cooking is realized, the optimal cooking effect is ensured, meanwhile, intelligent full-automatic cooking is realized, the convenience of the cooking appliance is improved, and the operation is convenient and reliable; in another aspect, the food weight is detected by using the image recognition target detection technology, a weight sensor is not required to be arranged, the food weight can be obtained independently, errors caused by weight detection of a container containing food materials are avoided, the structure of the cooking appliance can be simplified, the manufacturing cost is reduced, and the miniaturization of the cooking appliance is facilitated.
According to a fourth aspect of the present invention, there is provided a readable storage medium having stored thereon a program or instructions which, when executed by a processor, performs the control method of the cooking appliance set forth in the first aspect. The readable storage medium has all the advantages of the control method of the cooking appliance proposed by the first aspect.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the structures shown in the drawings without creative efforts.
Fig. 1 is a flowchart illustrating a control method of a cooking appliance according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a control method of a cooking appliance according to another embodiment of the present invention;
fig. 3 is a flowchart illustrating a control method of a cooking appliance according to another embodiment of the present invention;
fig. 4 is a flowchart illustrating a control method of a cooking appliance according to another embodiment of the present invention;
fig. 5 is a flowchart illustrating a control method of a cooking appliance according to another embodiment of the present invention;
fig. 6 is a flowchart illustrating a control method of a cooking appliance according to still another embodiment of the present invention;
fig. 7 is a flowchart illustrating a control method of a cooking appliance according to still another embodiment of the present invention;
fig. 8 is a flowchart illustrating a control method of a cooking appliance according to still another embodiment of the present invention;
fig. 9 is a flowchart illustrating a control method of a cooking appliance according to still another embodiment of the present invention;
FIG. 10 is a flowchart illustrating a method of controlling an oven according to an exemplary embodiment of the present invention;
fig. 11 is a block diagram schematically illustrating a cooking appliance according to an embodiment of the present invention.
The reference numbers illustrate:
100 cooking utensils, 200 main parts, 300 door bodies, 400 camera devices and 500 display screens.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments of the present invention and features of the embodiments may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited to the specific embodiments disclosed below.
A control method of a cooking appliance, a server, and a readable storage medium according to some embodiments of the present invention are described below with reference to fig. 1 to 11.
Example 1:
as shown in fig. 1, according to an embodiment of the present invention, there is provided a method of controlling a cooking appliance, the method including:
step 102, determining category information and weight information of food materials according to food material images of food materials in a cooking appliance;
and step 104, determining cooking parameters corresponding to the food materials according to the category information and the weight information, and controlling the cooking appliance to work.
In this embodiment, after the food material is determined to be placed in the cooking cavity of the cooking appliance, the category information of the food material is identified by using the food material image of the food material in the cooking appliance, and the weight information of the food material is estimated according to the proportion of the food material in the food material image. And searching a pre-stored database according to the category information and the weight information of the food materials, and acquiring cooking parameters corresponding to the category information and the weight information, wherein the cooking parameters comprise cooking temperature and cooking time. On one hand, the cooking parameters suitable for food materials can be automatically matched, the categories of the food materials are not limited, the key operation of a user is not needed, one-key cooking is realized, the optimal cooking effect is ensured, meanwhile, the intelligent full-automatic cooking is realized, the convenience of a cooking appliance is improved, and the operation is convenient and reliable; on the other hand, the food weight is detected by utilizing the image recognition target detection technology, a weight sensor is not required to be arranged, the food weight can be obtained independently, the error caused by the weight detection of a container for containing food materials is avoided, the structure of the cooking appliance can be simplified, the manufacturing cost is reduced, and the miniaturization of the cooking appliance is facilitated.
Specifically, the image recognition target detection technology includes at least one of: a Yolo (you Only Look one) model, a fast-RCNN model, a Mask-RCNN model, a ResNet (deep residual network) model.
Further, the user can edit a database including the correspondence of cooking parameters with category information and weight information in order to meet individual needs of the user.
It can be understood that the food material image can be a two-dimensional image or a three-dimensional image, the category information of the food material is identified through the two-dimensional image, the size information is identified through the three-dimensional image, and then the weight information of the food material is determined.
Further, image enhancement processing is carried out after the image is obtained, so that the image definition is improved, and accurate detection of the category information and the weight information is facilitated.
Example 2:
as shown in fig. 2, according to an embodiment of the present invention, there is provided a method of controlling a cooking appliance, the method including:
step 202, identifying outline information of food materials in the food material images and position information of the food materials in a cooking appliance;
step 204, determining the volume information of the food material according to the contour information and the position information;
step 206, obtaining density information of the food material;
step 208, determining weight information according to the volume information and the density information;
and step 210, determining cooking parameters corresponding to the food materials according to the category information and the weight information, and controlling the cooking appliance to work.
In this embodiment, the food material profile is segmented using a target segmentation algorithm, such as a Mask-RCNN model, to obtain profile information of the food material, and the position information of the food material within the cooking appliance is analyzed using a target detection algorithm, such as a Yolo model, a fast-RCNN model, with reference to the cooking cavity of the cooking appliance. The actual size information of the food materials is determined according to the contour information and the position information of the food materials, and the volume information of the food materials is calculated according to the size of the food materials. The method comprises the steps of obtaining density information of food materials, and calculating weight information of the corresponding food materials according to a formula of weight (m) to density (rho) multiplied by volume (V). Thereby can detect out alone through eating the material image and eat material weight, avoid holding the container of eating the material and detect the error that causes to weight for the edible material cooking temperature and the culinary art time of setting for are more accurate, need not to set up weighing transducer moreover, simplify cooking utensil structure, reduce manufacturing cost, are favorable to reducing cooking utensil's occupation space.
Taking the oven as an example, the oven has an upper layer, a middle layer and a lower layer, and a user can select different layers to place food materials according to experience, and intelligently analyze food material pictures to obtain the food material placement positions of the upper layer, the middle layer and the lower layer.
Further, the number of the food materials placed in the cooking appliance can be accurately analyzed through the profile information of the food materials, if the number of the food materials is multiple, the volume information of each food material is determined respectively, and the total volume of the food materials can be obtained by accumulating the volume of each food material. Of course, for food materials with regular shapes, such as chicken wings and egg tarts, the volume of each food material is basically uniform, so that the volume information of all food materials does not need to be identified, and the total volume of the food materials can be obtained by multiplying the volume of each food material by the number of the food materials.
It can be understood that the density information of the food material can be obtained through data set by a user, and the corresponding density information can also be called in a database through the category information of the food material.
Example 3:
as shown in fig. 3, according to an embodiment of the present invention, there is provided a method of controlling a cooking appliance, the method including:
step 302, identifying outline information of food materials in the food material images and position information of the food materials in the cooking utensil;
step 304, determining the distance between the food material and a camera of the cooking appliance according to the position information;
step 306, determining the size information of the food material according to the contour information and the distance;
step 308, determining volume information according to the size information;
step 310, acquiring density information of food materials;
step 312, determining weight information according to the volume information and the density information;
and step 314, determining the cooking parameters corresponding to the food materials according to the category information and the weight information, and controlling the cooking appliance to work.
In this embodiment, the distance between the food material and the imaging device of the cooking appliance is determined according to the position information of the food material in the cooking appliance, so as to determine the proportion of the food material in the food material image, and geometric calculation is performed according to the proportion and the identified outline information of the food material, so as to obtain the actual size information of the food material, wherein the size information includes the length, width, height, surface area and the like of the food material. The volume information of eating the material can be calculated according to size information, and then the weight information of eating the material is calculated with density to utilize weight automatic matching to eat the required best cooking parameter of material culinary art, provide reliable foundation for follow-up control cooking utensil work, convenient and fast, simultaneously, need not the manual work and set up the relevant data of culinary art, for the user of no culinary art experience provides accurate culinary art parameter, reduce the culinary art degree of difficulty, improve cooking utensil's culinary art efficiency and effect.
Example 4:
as shown in fig. 4, according to an embodiment of the present invention, there is provided a method of controlling a cooking appliance, the method including:
step 402, identifying outline information of food materials in the food material images and position information of the food materials in the cooking utensil;
step 404, determining the distance between the food material and the camera of the cooking appliance according to the position information;
step 406, determining the size information of the food material according to the contour information and the distance;
step 408, determining volume information according to the size information;
step 410, obtaining density information of food materials;
step 412, determining the number of each type of food materials in different types of food materials according to the contour information and the type information;
step 414, determining weight information according to the quantity, volume information and density information corresponding to each type of food materials in different types of food materials;
and step 416, determining the cooking parameters corresponding to the food materials according to the category information and the weight information, and controlling the cooking appliance to work.
In this embodiment, for the case that a plurality of different types of food materials exist in the cooking appliance, the number of each type of food material in the different types of food materials is determined according to the profile information and the category information of the food materials. And respectively calculating the weight information of each type of food material according to the corresponding quantity, volume information and density information of each type of food material in different types of food materials, and summing the weight information of each type of food material to obtain the total weight of all food materials in the cooking appliance.
As shown in fig. 5, further, in step 412, determining the number of each of the different types of food materials according to the profile information and the category information, specifically includes:
step 4122, determining a regression frame of each food material according to the contour information;
step 4124, determining the total amount of the food materials according to the number of the regression frames;
step 4126, determining the number of each of the different categories of food material according to the total number and the category information.
In this embodiment, the profile information of the food materials is obtained through an image detection technology, the regression frames of each food material in the profile information are determined, the total number of the food materials can be identified through the number of the regression frames, and then the total number of the food materials is divided according to the category information of the food materials, so that the number of each type of food materials in different categories of food materials can be obtained. So as to calculate each class respectively and eat material weight information to can discern the edible material of different classes, improve the degree of accuracy of eating material weight detection, make the cooking parameter of matching out laminate the actual required culinary art condition of edible material more, guarantee cooking utensil's culinary art effect.
Example 5:
as shown in fig. 6, according to an embodiment of the present invention, there is provided a method of controlling a cooking appliance, the method including:
step 502, identifying outline information and characteristic information of food materials in the food material image and position information of the food materials in a cooking appliance;
step 504, determining the volume information of the food material according to the contour information and the position information;
step 506, acquiring density information of the food material;
step 508, determining weight information according to the volume information and the density information;
step 510, determining similarity between the characteristic information and the characteristics of the preset food materials;
step 512, determining category information according to preset food material characteristics with the similarity greater than or equal to a similarity threshold;
and 514, determining the cooking parameters corresponding to the food materials according to the category information and the weight information, and controlling the cooking appliance to work.
In this embodiment, the characteristic information of the food material in the food material image is identified by using a pattern recognition algorithm, such as a ResNet model, and the characteristic information of the food material is compared with the preset food material characteristics to obtain the similarity between the characteristic information and the preset food material characteristics, that is, the probability of the category to which the food material belongs. If the similarity is greater than or equal to the preset similarity threshold, which indicates that the matching degree of the characteristic information and the preset food material characteristics is high, the category corresponding to the preset food material characteristics with the similarity greater than or equal to the preset similarity threshold is used as the category information of the food material. Therefore, the categories of the food materials can be accurately identified, different cooking parameters can be adjusted according to different food materials, the cooking requirements of different categories and quantities of food materials are met, and the use experience of a user is improved.
Example 6:
as shown in fig. 7, according to an embodiment of the present invention, there is provided a control method of a cooking appliance, the method including:
step 602, determining category information and weight information of food materials according to food material images of food materials in a cooking appliance;
step 604, determining cooking parameters corresponding to the food materials according to the category information and the weight information;
step 606, displaying cooking parameters;
step 608, whether a confirmation instruction of the cooking parameter is detected or not is judged, if yes, the step 610 is executed, and if not, the process is ended;
and step 610, controlling the operation of the cooking appliance according to the cooking parameters.
In the embodiment, when cooking is needed, the cooking parameters are automatically matched according to the category information and the weight information of the food materials, and the obtained cooking parameters are displayed, so that a user can timely and clearly know the set cooking parameters. If the confirmation instruction of the cooking parameters is detected, the user confirms to execute the cooking parameters, and then the cooking appliance is controlled to perform cooking work according to the current cooking parameters. And if the user is not satisfied with the current cooking parameters or the current cooking parameters are not matched with the current food materials, re-identifying the category and the weight of the food materials, adjusting the cooking parameters in time or manually adjusting the cooking parameters by the user, and controlling the cooking appliance to perform cooking work according to the adjusted cooking parameters. Thereby promoted cooking utensil's interpersonal interactive performance, the user can confirm and adjust the culinary art parameter, avoids the setting error of culinary art parameter, can control cooking utensil more nimble, has improved user's culinary art process's experience.
Specifically, the user may adjust the cooking parameters by operating an input key or knob or the like provided on the surface of the cooking appliance.
Further, the analyzed category information and weight information can be displayed before the cooking parameters are determined according to the category information and the weight information, and a user can set the cooking parameters according to the category information and the weight information, so that the cooking appliance can work according to the user requirements, and the cooking requirements of the user on different food materials are met.
Example 7:
as shown in fig. 8, according to an embodiment of the present invention, there is provided a method of controlling a cooking appliance, the method including:
step 702, determining category information and weight information of food materials according to food material images of food materials in a cooking appliance;
step 704, determining cooking parameters corresponding to the food materials according to the category information and the weight information;
step 706, sending cooking parameters to a terminal associated with the cooking appliance;
step 708, judging whether a confirmation instruction of the cooking parameters is detected, if so, entering step 710, and if not, ending the process;
step 710, controlling the cooking appliance to work according to the cooking parameters;
step 712, obtaining the working time of the cooking appliance;
step 714, determining and displaying the remaining working time length according to the difference value between the cooking time length and the working time length in the cooking parameters;
step 716, determining whether the working time is longer than or equal to the cooking time, if so, entering step 718, and if not, entering step 714;
and step 718, controlling the cooking appliance to stop working, and sending prompt information.
In this embodiment, the cooking appliance can perform information interaction with the terminal, and when cooking is required, the cooking parameters are automatically matched according to the category information and the weight information of the food materials, and the cooking parameters are sent to the user terminal, so that a user can timely and clearly know the set cooking parameters. If the confirmation instruction of the cooking parameters is detected, the user confirms to execute the cooking parameters, and then the cooking appliance is controlled to perform cooking work according to the current cooking parameters. And if the user is not satisfied with the current cooking parameters or the current cooking parameters are not matched with the current food materials, re-identifying the category and the weight of the food materials, adjusting the cooking parameters in time or manually adjusting the cooking parameters by the user, and controlling the cooking appliance to perform cooking work according to the adjusted cooking parameters. Thereby promoted cooking utensil's interpersonal interactive performance, the user can confirm and adjust the culinary art parameter, avoids the setting error of culinary art parameter, can control cooking utensil more nimble, has improved user's culinary art process's experience.
Specifically, the manner of information interaction between the cooking appliance and the terminal is not limited to infrared transmission, WIFI (wireless local area network) transmission, zigbee transmission, bluetooth transmission, or the like.
Further, the working time of the cooking appliance is obtained, namely the cooking appliance works according to the cooking parameter, the difference value between the cooking time and the working time in the cooking parameter is calculated, the residual working time required for the food to reach the target state is determined and displayed, so that the user can count down in cooking, the user can intuitively know the time required for cooking, the user can plan the cooking, the cooking efficiency is improved, and the use experience of the user is improved.
In addition, when the working time of the cooking appliance is longer than or equal to the cooking time, the cooking appliance is controlled to stop working and prompt information is sent to prompt the user that the cooking is finished. Therefore, whether the food materials are mature or not is judged without manual work, the food materials are automatically cooked according to the set cooking parameters, the observation time of a user is saved, great convenience is brought to the user, and the use experience of the user is greatly enhanced.
Specifically, the prompting mode includes at least one of the following: image, voice, text, video, light.
Example 8:
as shown in fig. 9, according to an embodiment of the present invention, there is provided a control method of a cooking appliance, the method including:
step 802, whether a door closing signal of the cooking appliance is detected or not is judged, if yes, the step 804 is carried out, and if not, the step 802 is repeated;
step 804, acquiring a cavity image of the cooking utensil;
step 806, identifying the bearing state of the cooking appliance according to the cavity image;
step 808, judging whether the cooking appliance is in an idle state, if so, entering step 810, and if not, entering step 812;
step 810, sending an alarm prompt;
step 812, taking the cavity image as a food material image;
step 814, determining category information and weight information of food materials according to food material images of food materials in the cooking appliance;
and 816, determining cooking parameters corresponding to the food materials according to the category information and the weight information, and controlling the cooking appliance to work.
In this embodiment, the cooking appliance is provided with a door body and a door closing detection sensor for outputting a door closing signal. If the door closing signal is detected, the user executes the operation from opening the door body to closing the door body, and then the cavity image of the cooking appliance is obtained. Therefore, the invalid work of the camera device is avoided, the service life of the camera device is prolonged, and the energy consumption of the cooking utensil is reduced.
Further, the bearing condition inside the cavity of the cooking appliance is monitored according to the cavity image, if the cooking appliance is in a non-idle state, namely food materials are placed in the cooking appliance, the cavity image is used as a food material image, the category information and the weight information of the food materials are analyzed through the food material image, and automatic matching of cooking parameters is achieved, so that the image processing load of the cooking appliance is effectively reduced, and energy consumption is reduced. If the cooking utensil is in the idle state, explain that the user forgets to put into the edible material, then send the warning suggestion, avoid the danger that cooking utensil idle running leads to ensured user's life and property safety, promoted cooking utensil security, avoided the unnecessary consumption simultaneously, saved the resource, promoted user experience.
Specifically, the camera device can be controlled to acquire the current cavity image of the cooking appliance, or the cavity image is intercepted from the video recorded by the camera device.
It should be noted that, when the food material is located right below the camera, the height of the food material cannot be identified by the image, so that when the food material is placed, an included angle between a connecting line between the camera and the food material and a food material placing plane (a plane perpendicular to the height direction of the cooking appliance) is required to be smaller than 90 °, and a certain distance is formed between the camera and the food material, so that the complete food material can be shot.
Example 9:
as shown in fig. 10, according to an embodiment of the present invention, there is provided a control method of an oven, the method including:
step 902, putting food materials into the container, and generating a door closing signal;
step 904, shooting a cavity picture by a camera, and identifying the category of food materials;
step 906, performing food material detection and food material segmentation processing on the cavity picture;
step 908, estimating the weight of the food material according to the food material category;
step 910, displaying a food material category and weight information sending value screen, and waiting for selection/starting of a user;
step 912, the database matches the temperature and time parameters and starts the oven to work.
In this embodiment, a camera (a camera device) is placed in the oven product, the camera is connected with the driving circuit board, and is used for taking pictures inside the cavity, and can take complete food material pictures inside the cooking cavity without limitation, a user puts in food materials, closes the oven door, the door closing detection sensor automatically detects the door closing, and outputs a door closing signal; the signal of closing the door triggers the camera to shoot oven cavity picture (or the user clicks the picture of shooing manually), handles the picture at local processing/transmission high in the clouds, outputs four results:
1. the layer position of the food material is as follows: the general oven has upper, middle and lower three-layer, and different levels are corresponding to different levels for the different baking edible materials, and the user also can select different levels to put into edible material according to experience, and shoot picture intelligent analysis edible material and place 4 results on upper, middle, lower floor, no-load, if the recognition result is no-load, then do not carry out follow-up analysis, according to the built-in parameter of upper, middle and lower three-layer, confirm the distance between camera and edible material, this distance is used for follow-up analysis edible material volume.
2. Food material detection: detecting the position and regression frame of each food material (aiming at a plurality of food materials) by an image recognition target detection technology (such as Yolo, fast-RCNN), confirming the number of the food materials by the number of the regression frames, and if the number of the food materials is more, calculating the total weight of the food materials according to the food material types within the range of limiting the food material types; for common regular food materials, such as chicken wings and egg tarts, the weight of each food material is basically uniform, and the total weight of the food materials can be obtained by multiplying the weight of each food material by the number of the food materials.
3. Food material segmentation: the method comprises the steps of segmenting the outline of the food material (aiming at a single food material) by an image recognition target segmentation technology (such as Mask-RCNN), obtaining the distance between the food material and a camera according to the layer position of the food material, and calculating to obtain the surface area and height information of the food material through geometric calculation. The product of the surface area and the height can obtain the volume of the food material. And (4) obtaining the total weight of the food material by multiplying the volume of the food material by the category density of the food material.
4. And outputting the probability of the corresponding food material category in the picture through a pattern recognition algorithm (such as ResNet).
Sending the food material category and weight information to a screen for presentation, and waiting for selection of a user or starting cooking by the user; and receiving user selection/starting information, matching temperature and time information from a database, and starting the oven to work by the electric control. Therefore, the category and the weight of the food materials can be identified by the camera, the optimal baking temperature and the optimal baking time are matched, accurate one-key cooking is realized, and the cooking effect is ensured; moreover, after the food materials are put in, the parameters are automatically identified and matched without any operation of a user, and the method is convenient and quick.
Wherein, the camera can be placed in the oven door body, considers putting at the door body because the camera temperature resistant is low, and door body temperature is whole cavity temperature minimum position, can also add heat radiation structure simultaneously, for example air-cooled structure guarantees that the camera temperature is in safety range.
It should be noted that, when the food material is located right below the camera, the height of the food material cannot be identified by the image, so that an included angle between a connecting line between the camera and the middle layer food material and a food material placing plane is limited to be smaller than 90 degrees (the angle is not limited, and is not perpendicular), and a certain distance is formed between the camera and the food material, so that a complete food material picture can be shot.
Example 10:
as shown in fig. 11, according to an embodiment of the second aspect of the present invention, there is provided a cooking appliance 100 including: the main body 200, the door 300, a memory (not shown), a processor (not shown), and the image pickup device 400.
In detail, the main body 200 is provided with a cooking cavity, the camera 400 is arranged in the door 300, a program or an instruction is stored in the memory, the camera 400 can acquire a cavity image of the cooking cavity, the processor is connected with the memory and the camera 400, and when the processor executes the program or the instruction, the following steps are executed, so that the category information and the weight information of the food material are determined according to the food material image of the food material in the cooking appliance 100; and determining cooking parameters corresponding to the food materials according to the category information and the weight information, and controlling the cooking appliance 100 to work.
In this embodiment, after the food material is determined to be placed in the cooking cavity of the cooking appliance, the category information of the food material is identified by using the food material image of the food material in the cooking appliance, and the weight information of the food material is estimated according to the proportion of the food material in the food material image. And searching a pre-stored database according to the category information and the weight information of the food materials, and acquiring cooking parameters corresponding to the category information and the weight information, wherein the cooking parameters comprise cooking temperature and cooking time. On one hand, the cooking parameters suitable for food materials can be automatically matched, the categories of the food materials are not limited, the key operation of a user is not needed, one-key cooking is realized, the optimal cooking effect is ensured, meanwhile, the intelligent full-automatic cooking is realized, the convenience of a cooking appliance is improved, and the operation is convenient and reliable; on the other hand, the food material weight is detected by using the image recognition target detection technology, a weight sensor is not required to be arranged, the food material weight can be obtained independently, errors caused by weight detection of a container containing food materials are avoided, the structure of the cooking appliance can be simplified, the manufacturing cost is reduced, and the miniaturization of the cooking appliance 100 is facilitated. On the other hand, the door 300 and the main body 200 can be connected in an openable and closable manner to open or close the cooking cavity, considering that the temperature of the door is the lowest position of the temperature of the whole cavity, in order to avoid damage caused by overhigh temperature of the camera 400, the camera 400 can be arranged in the door 300 to ensure that the temperature of the camera 400 is within a safe range, and the door 300 can prevent steam or oil stain generated in the cooking process from being attached to the camera 400, so that the cleanliness of the camera 400 is kept, and the definition of the cavity image is further ensured.
Further, the cooking appliance 100 further includes a display screen 500, and the display screen 500 is connected to the main body 200 for displaying data such as category information, weight information, cooking parameters, remaining operating time, and the like.
Further, the cooking appliance 100 further includes a heat dissipation device (not shown in the figure) connected to the main body to perform heat dissipation processing on the image pickup device, so as to prevent heat generated during the heating process of the cooking appliance or heat generated during long-time operation of the image pickup device from damaging the image pickup device, and effectively prolong the service life of the image pickup device. In particular, the heat sink may be an air-cooled structure.
Specifically, the cooking appliance 100 includes: and food heating equipment such as ovens, steam boxes, microwave ovens, electric cookers and the like.
Example 11:
according to an embodiment of the third aspect of the present invention, there is provided a server including: a communication component, a memory, and a processor.
In detail, the communication assembly is used for receiving a cavity image of the cooking appliance. The memory stores programs or instructions. The processor is connected with the memory and the communication assembly, and executes the following steps when executing the program or the instruction, wherein the processor determines the category information and the weight information of the food material according to the food material image of the food material in the cooking appliance; and determining cooking parameters corresponding to the food materials according to the category information and the weight information, and controlling the cooking appliance to work.
In this embodiment, the cooking appliance is used to image the cavity of the server through the communication module during operation. After receiving the cavity image, the server identifies the category information and the weight information of the food materials in the cavity image, determines appropriate cooking parameters according to the category information and the weight information, and sends a control instruction carrying the cooking parameters to the cooking appliance to enable the cooking appliance to work. On one hand, data analysis and processing are carried out through the cloud server, the speed and the accuracy of determining cooking parameters are improved, meanwhile, a database and a data analysis processing assembly are not required to be arranged in a cooking appliance which is interacted with the server, the running cost of the cooking appliance is reduced, miniaturization of the cooking appliance is facilitated, on the other hand, the cooking parameters suitable for food materials can be automatically matched, the category of the food materials is not limited, key operation of a user is not required, one-key cooking is realized, the optimal cooking effect is ensured, meanwhile, intelligent full-automatic cooking is realized, the convenience of the cooking appliance is improved, and the operation is convenient and reliable; in another aspect, the food weight is detected by using the image recognition target detection technology, a weight sensor is not required to be arranged, the food weight can be obtained independently, errors caused by weight detection of a container containing food materials are avoided, the structure of the cooking appliance can be simplified, the manufacturing cost is reduced, and the miniaturization of the cooking appliance is facilitated.
Example 12:
according to an embodiment of the fourth aspect of the present invention, a readable storage medium is proposed, on which a program or instructions are stored, which when executed by a processor performs the control method of the cooking appliance proposed by the embodiment of the first aspect. Therefore, the readable storage medium has all the advantages of the control method of the cooking appliance provided in the embodiment of the first aspect, and details are not described herein again.
In the description herein, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance unless explicitly stated or limited otherwise; the terms "connected," "mounted," "secured," and the like are to be construed broadly and include, for example, fixed connections, removable connections, or integral connections; may be directly connected or indirectly connected through an intermediate. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the description herein, the description of the terms "one embodiment," "some embodiments," "specific embodiments," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (14)

1. A method of controlling a cooking appliance, comprising:
determining category information and weight information of food materials according to food material images of the food materials in the cooking appliance;
and determining the cooking parameters corresponding to the food materials according to the category information and the weight information, and controlling the cooking appliance to work.
2. The method for controlling a cooking appliance according to claim 1, wherein the determining the weight information of the food material according to the food material image of the food material in the cooking appliance specifically comprises:
identifying contour information of the food material in the food material image and position information of the food material in the cooking appliance;
determining the volume information of the food material according to the contour information and the position information;
acquiring density information of the food material;
and determining the weight information according to the volume information and the density information.
3. The method for controlling a cooking appliance according to claim 2, wherein the determining the volume information of the food material according to the contour information and the position information specifically comprises:
determining the distance between the food material and a camera of the cooking appliance according to the position information;
determining the size information of the food material according to the contour information and the distance;
determining the volume information from the size information.
4. The method of claim 2, wherein the determining the weight information based on the category information includes a plurality of different categories, the determining the weight information based on the volume information and the density information includes:
determining the quantity of each type of food materials in different types of food materials according to the contour information and the category information;
and determining the weight information according to the number, the volume information and the density information corresponding to each type of food materials in the different types of food materials.
5. The method of claim 4, wherein the determining the number of each of the different categories of food materials according to the profile information and the category information specifically comprises:
determining a regression frame of each food material according to the contour information;
determining the total amount of the food materials according to the number of the regression boxes;
and determining the quantity of each type of food materials in the different types of food materials according to the total quantity and the type information.
6. The method for controlling a cooking appliance according to any one of claims 1 to 5, wherein the determining the category information of the food material according to the food material image of the food material in the cooking appliance specifically comprises:
identifying characteristic information of the food material in the food material image;
determining the similarity between the characteristic information and the characteristics of preset food materials;
and determining the category information according to the preset food material characteristics with the similarity greater than or equal to a similarity threshold.
7. The method for controlling the cooking appliance according to any one of claims 1 to 5, wherein the determining the cooking parameter corresponding to the food material and controlling the cooking appliance to operate specifically includes:
displaying the cooking parameters and/or sending the cooking parameters to a terminal associated with the cooking appliance;
and controlling the cooking appliance to work according to the cooking parameters based on the confirmation instruction of the detected cooking parameters.
8. The control method of the cooking appliance according to any one of claims 1 to 5, further comprising:
acquiring the working time of the cooking appliance;
determining and displaying the remaining working time length according to the difference value between the cooking time length and the working time length in the cooking parameters;
and controlling the cooking appliance to stop working and sending prompt information based on the working time length being greater than or equal to the cooking time length.
9. The method for controlling a cooking appliance according to any one of claims 1 to 5, wherein before determining the category information and the weight information of the food material according to the food material image of the food material in the cooking appliance, the method further comprises:
acquiring a cavity image of the cooking appliance;
identifying the bearing state of the cooking appliance according to the cavity image;
and taking the cavity image as the food material image based on the fact that the cooking appliance is in a non-idle state.
10. The method for controlling the cooking appliance according to claim 9, wherein the acquiring the cavity image of the cooking appliance specifically comprises:
acquiring the cavity image based on the detected door closing signal of the cooking appliance.
11. A cooking appliance, comprising:
a body having a cooking cavity;
the camera device is used for acquiring a cavity image of the cooking cavity;
a memory storing a program or instructions;
a processor connected to the memory and the imaging device, the processor executing the program or the instructions to perform the method of controlling the cooking appliance according to any one of claims 1 to 10.
12. The cooking appliance of claim 11, further comprising:
the door body is connected with the main body in an openable and closable manner; and/or
The heat dissipation device is connected with the main body and used for carrying out heat dissipation treatment on the camera device;
the camera device is arranged in the door body or the cooking cavity.
13. A server, comprising:
a communication component for receiving a cavity image of a cooking appliance;
a memory storing a program or instructions;
a processor connected with the memory, the communication component, the processor executing the program or the instructions to perform the control method of the cooking appliance according to any one of claims 1 to 10.
14. A readable storage medium on which a program or instructions are stored, characterized in that the program or instructions, when executed by a processor, perform a control method of a cooking appliance according to any one of claims 1 to 10.
CN202011369263.1A 2020-11-30 2020-11-30 Control method, cooking appliance, server and readable storage medium Pending CN112426060A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011369263.1A CN112426060A (en) 2020-11-30 2020-11-30 Control method, cooking appliance, server and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011369263.1A CN112426060A (en) 2020-11-30 2020-11-30 Control method, cooking appliance, server and readable storage medium

Publications (1)

Publication Number Publication Date
CN112426060A true CN112426060A (en) 2021-03-02

Family

ID=74698548

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011369263.1A Pending CN112426060A (en) 2020-11-30 2020-11-30 Control method, cooking appliance, server and readable storage medium

Country Status (1)

Country Link
CN (1) CN112426060A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113040618A (en) * 2021-03-31 2021-06-29 广东美的厨房电器制造有限公司 Control method of cooking apparatus, and readable storage medium
CN113576245A (en) * 2021-08-30 2021-11-02 广东万家乐燃气具有限公司 Integrated stove with steaming and baking oven
CN113633186A (en) * 2021-07-13 2021-11-12 佛山倍翔自动化科技有限公司 Curing control system and control method thereof

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106872513A (en) * 2017-01-05 2017-06-20 深圳市金立通信设备有限公司 A kind of method and terminal for detecting fuel value of food
CN109349913A (en) * 2018-10-23 2019-02-19 杭州若奇技术有限公司 Cooking control method, cooking apparatus, Cloud Server and culinary art control system
CN109541985A (en) * 2018-10-16 2019-03-29 珠海格力电器股份有限公司 A kind of control method and cooking apparatus of cooking apparatus
CN110020609A (en) * 2019-03-15 2019-07-16 吕丹青 A kind of method, system and storage medium for analyzing food
CN110780628A (en) * 2019-11-20 2020-02-11 广东美的厨房电器制造有限公司 Control method and device of cooking equipment, cooking equipment and storage medium
CN110806699A (en) * 2019-11-20 2020-02-18 广东美的厨房电器制造有限公司 Control method and device of cooking equipment, cooking equipment and storage medium
CN110969047A (en) * 2018-09-28 2020-04-07 珠海格力电器股份有限公司 Method and device for identifying food materials and refrigerator
CN111219753A (en) * 2019-12-19 2020-06-02 珠海格力电器股份有限公司 Cooking processing method, device, equipment and computer readable medium
CN111290446A (en) * 2020-01-19 2020-06-16 广东美的厨房电器制造有限公司 Control method, cooking appliance and computer-readable storage medium
CN111345699A (en) * 2018-12-20 2020-06-30 九阳股份有限公司 Control method of cooking equipment and cooking equipment
CN111720866A (en) * 2020-06-18 2020-09-29 广东美的厨房电器制造有限公司 Control method of cooking appliance, cooking appliance and computer readable storage medium
CN211582580U (en) * 2019-06-28 2020-09-29 深圳拓邦股份有限公司 Cooking system

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106872513A (en) * 2017-01-05 2017-06-20 深圳市金立通信设备有限公司 A kind of method and terminal for detecting fuel value of food
CN110969047A (en) * 2018-09-28 2020-04-07 珠海格力电器股份有限公司 Method and device for identifying food materials and refrigerator
CN109541985A (en) * 2018-10-16 2019-03-29 珠海格力电器股份有限公司 A kind of control method and cooking apparatus of cooking apparatus
CN109349913A (en) * 2018-10-23 2019-02-19 杭州若奇技术有限公司 Cooking control method, cooking apparatus, Cloud Server and culinary art control system
CN111345699A (en) * 2018-12-20 2020-06-30 九阳股份有限公司 Control method of cooking equipment and cooking equipment
CN110020609A (en) * 2019-03-15 2019-07-16 吕丹青 A kind of method, system and storage medium for analyzing food
CN211582580U (en) * 2019-06-28 2020-09-29 深圳拓邦股份有限公司 Cooking system
CN110780628A (en) * 2019-11-20 2020-02-11 广东美的厨房电器制造有限公司 Control method and device of cooking equipment, cooking equipment and storage medium
CN110806699A (en) * 2019-11-20 2020-02-18 广东美的厨房电器制造有限公司 Control method and device of cooking equipment, cooking equipment and storage medium
CN111219753A (en) * 2019-12-19 2020-06-02 珠海格力电器股份有限公司 Cooking processing method, device, equipment and computer readable medium
CN111290446A (en) * 2020-01-19 2020-06-16 广东美的厨房电器制造有限公司 Control method, cooking appliance and computer-readable storage medium
CN111720866A (en) * 2020-06-18 2020-09-29 广东美的厨房电器制造有限公司 Control method of cooking appliance, cooking appliance and computer readable storage medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113040618A (en) * 2021-03-31 2021-06-29 广东美的厨房电器制造有限公司 Control method of cooking apparatus, and readable storage medium
CN113040618B (en) * 2021-03-31 2022-04-22 广东美的厨房电器制造有限公司 Control method of cooking apparatus, and readable storage medium
CN113633186A (en) * 2021-07-13 2021-11-12 佛山倍翔自动化科技有限公司 Curing control system and control method thereof
CN113576245A (en) * 2021-08-30 2021-11-02 广东万家乐燃气具有限公司 Integrated stove with steaming and baking oven

Similar Documents

Publication Publication Date Title
CN112426060A (en) Control method, cooking appliance, server and readable storage medium
CN110780628B (en) Control method and device of cooking equipment, cooking equipment and storage medium
US20230039201A1 (en) Tailored food preparation with an oven
EP3650758B1 (en) Automatic cooking device, method for operating an automatic cooking device, and computer-readable recording medium
EP2149755B1 (en) Oven and method of operating the same
CA2893601C (en) Heat treatment monitoring system
CN110806699A (en) Control method and device of cooking equipment, cooking equipment and storage medium
US10605463B2 (en) Cooking appliance with a user interface
CA3199520A1 (en) Heat treatment monitoring system
CN110488696B (en) Intelligent dry burning prevention method and system
CN107752794B (en) Baking method and device
CN211582580U (en) Cooking system
CN111386430B (en) Method for detecting an overload of a cooking appliance having a cooking product, and cooking appliance
CN108700306B (en) System for making at least one food item and method for operating a related system
CN114711644B (en) Control method and control device for cooking device, storage medium and cooking device
US20220273136A1 (en) Control Method and Device for Cooking Equipment, Cooking Equipment and Storage Medium
CN113854847A (en) Sensor control method and device for cooking appliance, electronic equipment and cooking appliance
CN116802681A (en) Method for determining the end of a cooking time of a food item and household cooking appliance
CN114903343A (en) Automatic steaming and baking method and device and steaming and baking box thereof
CN113310549B (en) Cookware liquid level monitoring method and system and computer storage medium
CN117322780A (en) Intelligent cooking method, device, equipment and medium for food
CN115177158A (en) Cooking utensil
JP2023084519A (en) heating cooker
CN115153312A (en) Cooking appliance and control method thereof
CN115704564A (en) Combustion early warning method and system for kitchen range

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination