CN111722543B - Baking control method, device and system - Google Patents
Baking control method, device and system Download PDFInfo
- Publication number
- CN111722543B CN111722543B CN201910214823.7A CN201910214823A CN111722543B CN 111722543 B CN111722543 B CN 111722543B CN 201910214823 A CN201910214823 A CN 201910214823A CN 111722543 B CN111722543 B CN 111722543B
- Authority
- CN
- China
- Prior art keywords
- current state
- food material
- recipe
- display content
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
Abstract
The invention discloses a control method, a control device and a control system, wherein the control method applied to a terminal side comprises the following steps: when the food materials are detected to enter a preset making stage, outputting prompt information; the prompting information is used for prompting the user whether to start an AR teaching mode; if the AR teaching mode is determined to be started, acquiring an image of the food material, and sending acquired image data to a server; receiving AR display content determined by the server based on the image data; wherein the AR display content comprises production steps and/or modification suggestions given for a current state of the food material, the current state being obtained based on the image data analysis; and outputting the AR display content so that the user can make food materials by referring to the AR display content.
Description
Technical Field
The invention relates to the technical field of household appliance control, in particular to a control method, a control device and a control system.
Background
Providing better service for users has been a very challenging problem in the field of household appliances, and kitchen appliances, as a large category of household appliances, have not been developed and excavated sufficiently in intelligence degree, convenience and practicability.
At present, recipes for making baked food in the market are all taught in a picture or video mode. For novice users, the shaping difficulty of baked foods is high, and the picture or video mode does not necessarily explain the making process clearly. The inventor provides the application based on the experience of daily kitchen life, and deeply feels that how to provide better shaping and making guidance for baked food to a user is one of the problems to be solved urgently.
Disclosure of Invention
In view of the above, the present invention is to provide a control method, device and system, which can provide better guidance for making baked food for users.
In order to achieve the purpose, the technical scheme of the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides a control method, which is applied to a terminal side, where the control method includes:
when the food materials are detected to enter a preset making stage, outputting prompt information; the prompt information is used for prompting the user whether to start an Augmented Reality (AR) teaching mode;
if the AR teaching mode is determined to be started, acquiring an image of the food material, and sending acquired image data to a server;
receiving AR display content determined by the server based on the image data; wherein the AR display content comprises production steps and/or modification suggestions given for a current state of the food material, the current state being obtained based on the image data analysis;
and outputting the AR display content so that the user can make food materials by referring to the AR display content.
In the foregoing solution, optionally, the obtaining of the target recipe content includes:
sending a recipe list acquisition request to a server;
selecting a target recipe from the recipe list;
sending the target recipe content downloading request to the server;
receiving the target recipe content returned by the server, and making food materials by a user according to the target recipe content until the preset making stage is completed;
the target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
In a second aspect, an embodiment of the present invention provides a control method, which is applied to a server, and the control method includes:
receiving image data of food materials entering a preset making stage, which are sent by a terminal;
analyzing the current state of the food material based on the image data;
determining AR display content according to the current state; wherein the AR display content comprises a making step and/or a modification suggestion which are adapted to the current state of the food material;
and returning the AR display content to the terminal, and making food materials by the user according to the AR display content output by the terminal.
In the foregoing scheme, optionally, the method further includes:
receiving a recipe list acquisition request sent by a terminal;
returning a recipe list to the terminal based on the recipe list acquisition request;
receiving a target recipe content downloading request sent by a terminal, wherein the target recipe is selected from the recipe list;
returning the target recipe content to the terminal based on the target recipe content downloading request;
the target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
In the foregoing solution, optionally, the determining, according to the current state, the AR display content includes:
obtaining a predicted finished product effect according to current state information of the food materials, wherein the current state comprises the current shape and/or size of the food materials;
judging the difference between the predicted finished product effect and the target finished product effect to obtain a judgment result;
and determining a manufacturing step and/or a modification suggestion which are suitable for the current state of the food material according to the judgment result.
In a third aspect, an embodiment of the present invention provides a control apparatus, which is applied to a terminal side, where the control apparatus includes:
the first processing unit is used for detecting whether the food material enters a preset making stage or not;
the output unit is used for outputting prompt information when the processing unit detects that the food material enters a preset making stage; the prompting information is used for prompting the user whether to start an AR teaching mode;
a collecting unit for collecting the images of the food materials if the first processing unit determines to start the AR teaching mode,
the first communication unit is used for sending the acquired image data to the server; receiving AR display content determined by the server based on the image data; wherein the AR display content comprises production steps and/or modification suggestions given for a current state of the food material, the current state being obtained based on the image data analysis;
the output unit is further configured to output the AR display content, so that the user makes food materials by referring to the AR display content.
In the foregoing scheme, optionally, the first communication unit is further configured to send a recipe list acquisition request to a server;
the first processing unit is further used for selecting a target recipe from the recipe list;
the first communication unit is further used for sending the target recipe content downloading request to the server; receiving the target recipe content returned by the server, and making food materials by a user according to the target recipe content until the preset making stage is completed;
the target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
In a fourth aspect, an embodiment of the present invention provides a control apparatus, which is applied to a server, and the control apparatus includes:
the second communication unit is used for receiving the image data of the food material entering the preset making stage, which is sent by the terminal;
the second processing unit is used for analyzing the current state of the food material based on the image data; determining AR display content according to the current state; the AR display content comprises a making step and/or a modification suggestion which are adapted to the current state of the food material;
the second communication unit is further configured to return the AR display content to the terminal, so that the user refers to the AR display content output by the terminal to make the food material.
In the foregoing scheme, optionally, the second communication unit is further configured to receive a recipe list acquisition request sent by a terminal; returning a recipe list to the terminal based on the recipe list acquisition request; receiving a target recipe content downloading request sent by a terminal, wherein the target recipe is selected from the recipe list; returning the target recipe content to the terminal based on the target recipe content downloading request;
the target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
In the foregoing scheme, optionally, the second processing unit is further configured to:
obtaining a predicted finished product effect according to the current state of the food material, wherein the current state comprises the current shape and/or size of the food material;
judging the difference between the predicted finished product effect and the target finished product effect to obtain a judgment result;
and determining a manufacturing step and/or a modification suggestion which are suitable for the current state of the food material according to the judgment result.
In a fifth aspect, an embodiment of the present invention provides a control system, where the control system includes:
the terminal is used for outputting prompt information when detecting that the food materials enter a preset manufacturing stage; the prompting information is used for prompting the user whether to start an AR teaching mode; if the AR teaching mode is determined to be started, acquiring an image of the food material, and sending acquired image data to a server; receiving AR display content determined by the server based on the image data; the AR display content comprises making steps and/or transformation suggestions which are adaptive to the current state of the food material, and the current state is obtained based on the image data analysis; outputting the AR display content to enable a user to make food materials by referring to the AR display content;
the server is used for receiving the image data of the food materials entering the preset making stage, which are sent by the terminal; analyzing the current state of the food material based on the image data; determining AR display content according to the current state; wherein the AR display content comprises a making step and/or a modification suggestion which are adapted to the current state of the food material; and returning the AR display content to the terminal.
In a sixth aspect, an embodiment of the present invention provides a computer storage medium, in which a computer program is stored, the computer program being configured to execute the control method applied to the terminal side.
In a seventh aspect, an embodiment of the present invention provides a computer storage medium, in which a computer program is stored, the computer program being configured to execute the control method applied to the server.
According to the control method, the device and the system provided by the embodiment of the invention, when the control device at the user terminal side detects that the food material enters the preset making stage, the prompt information is output; the prompting information is used for prompting the user whether to start an AR teaching mode; if the AR teaching mode is determined to be started, acquiring images of the food materials, and sending acquired image data to a server; receiving AR display content determined by the server based on the image data; wherein the AR display content comprises production steps and/or modification suggestions given for a current state of the food material, the current state being obtained based on the image data analysis; outputting the AR display content to enable a user to make food materials by referring to the AR display content; therefore, by adopting the technical scheme of the invention, the current state of the food material is obtained through the cloud server based on the image data analysis, and the AR display content is determined according to the current state; wherein, AR show content includes the preparation step and/or the transformation suggestion that suit with the current state of eating the material, so, through AR's novel interactive mode, helps the user to carry out food preparation better more effectively, if provide better baked food plastic preparation guide to the user, can also let the user obtain more timely preparation effect feedback, has promoted user's use greatly and has experienced.
Drawings
Fig. 1 is a schematic implementation flowchart of a control method applied to a terminal side according to an embodiment of the present invention;
fig. 2 is a schematic flow chart illustrating an implementation of a control method applied to a server side according to an embodiment of the present invention;
FIG. 3 is a schematic flow chart of an implementation of providing bread-shaping instructions to a user according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a camera aligned with a dough when entering a VR teaching mode according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a control device applied to a terminal side according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a control device applied to a server side according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a control system according to an embodiment of the present invention.
Detailed Description
So that the manner in which the features and aspects of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings.
Example one
An embodiment of the present invention provides a control method, where the control method in this example is applied to a user terminal side, as shown in fig. 1, the control method mainly includes the following steps:
step 101: when the food materials are detected to enter a preset making stage, outputting prompt information; and the prompt information is used for prompting the user whether to start an AR teaching mode.
In this embodiment, the predetermined manufacturing stage represents a shaping processing stage, such as a shaping processing stage, performed on the food material.
For example, when the entering of the step of shaping the bread or the cake is detected, prompt information is output.
Here, the manner of outputting the prompt information is a manner capable of attracting the attention of the user, and may be, for example, output in the form of a prompt box or output in the form of voice.
Here, the AR teaching mode is a teaching mode that calculates the position and angle of a camera image in real time by using an Augmented Reality (AR) technology and adds a corresponding image, video, and 3D model.
As an embodiment, detecting whether the food material enters the predetermined preparation stage includes:
monitoring the whole process of food material making to judge whether the food material enters a preset making stage or not through the obtained monitoring information.
Here, the whole process of food material manufacturing can be monitored through an image acquisition device such as a camera on the terminal, and the whole process of food material manufacturing can also be monitored through an independent image acquisition device, and then the obtained monitoring information is sent to the terminal.
As another embodiment, detecting whether the food material enters a predetermined preparation stage includes:
detecting whether a preset operation is received;
if the preset operation is received, judging that the food material enters a preset making stage;
and if the preset operation is not received, judging that the food material does not enter the preset making stage.
Here, the preset operation may be understood as an operation of the terminal receiving a characterization food material input by a user to enter a predetermined preparation stage.
Step 102: and if the AR teaching mode is determined to be started, acquiring the images of the food materials, and sending the acquired image data to a server.
Here, the server may be a cloud server, and of course, may also be a general server.
As an embodiment, capturing an image of the food material comprises:
and calling an image acquisition device to align the food material to enter a preset manufacturing stage, and acquiring an image of the food material.
In this embodiment, the communication method between the terminal and the server is not limited. For example, the preset communication modes include, but are not limited to: bluetooth communication, infrared communication, serial communication, Wireless Fidelity (WIFI) communication, mobile data communication such as 2G, 3G, 4G, 5G, and the like.
Step 103: receiving AR display content determined by the server based on the image data; wherein the AR presentation content comprises production steps and/or modification suggestions given for a current state of the food material, the current state being obtained based on the image data analysis.
Here, the production steps and/or the modification recommendations are given in accordance with the current state of the food material.
Here, the current state is a feature that can reflect the state of the food material.
For example, the current state includes, but is not limited to, the current shape, size, material component, color, etc. of the food material.
For example, the server recommends shaping suggestions to the user that are appropriate for the current state of the dough based on the current state of the dough. Specifically, assuming that the user is to make a bun, and the standard bun has 3 shapes, the server recommends one or two of the three shapes to the user, the recommended one or two being compatible with the current state of the dough.
For another example, the server predicts that the finished pineapple bag manufactured in the current dough state is twice or three times of the pineapple bag in the common specification according to the current state of the dough; if the pineapple bread standard with the common specification size is achieved, the dough needs to be divided into two or three, and accordingly, the server provides modification suggestions to the user to divide the dough into two or three.
For another example, the server predicts that the color degree of the finished butter bread made in the current dough state is not transparent enough according to the current state of the dough; in order to meet the butter bread standard of the target specification, the server presents the user with a manufacturing step of further coating the dough with a layer of butter.
Step 104: and outputting the AR display content so that the user can make food materials by referring to the AR display content.
Therefore, the user can make food materials by referring to the AR display contents, and the food materials are more vivid, vivid and easy to understand.
So, through AR's novel interactive mode, help the user to carry out food preparation better more effectively, if provide better baked food plastic preparation to the user and guide, can also let the user obtain more timely preparation effect feedback, promoted user's use greatly and experienced.
For example, in the baking process of a user, when food materials enter a preset making stage, a terminal collects food material images and sends collected image data to a server; the server analyzes the current state of the food material based on the image data; determining a manufacturing step suitable for the current state of the food material and/or reforming recommended AR display content according to the current state; the server sends the AR display content to the terminal for display by the terminal, so that the baking is simple, scientific and reasonable, and the method is beneficial for a user to make food with more delicious taste, more nutrition and more beautiful shape according to the AR display content.
Further, before step 101, the method further comprises:
step 100 (not shown in fig. 1): acquiring target recipe content, and making food materials by a user according to the target recipe content until the preset making stage is completed;
the target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
Specifically, the user prepares the food material according to the target recipe content, for example, the food material is weighed, preprocessed and the like until the previous stage of the preset preparation stage is completed.
In some optional embodiments, the obtaining the target recipe content comprises:
sending a recipe list acquisition request to a server;
selecting a target recipe from the recipe list;
sending the target recipe content downloading request to the server;
and receiving the target recipe content returned by the server.
In this manner, the target recipe content may be obtained from the server.
In some optional embodiments, the obtaining the target recipe content comprises:
acquiring target recipe content from a terminal locally;
the target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
That is, the target recipe content may also be obtained locally from the terminal.
It should be noted that the present embodiment does not impose any restrictions on the manner of acquiring the target recipe content.
According to the technical scheme, when the food material is detected to enter the preset manufacturing stage, prompt information is output; the prompting information is used for prompting the user whether to start an AR teaching mode; if the AR teaching mode is determined to be started, acquiring an image of the food material, and sending acquired image data to a server; receiving AR display content determined by the server based on the image data; wherein the AR display content comprises production steps and/or modification suggestions given for a current state of the food material, the current state being obtained based on the image data analysis; outputting the AR display content to enable a user to make food materials by referring to the AR display content; therefore, by adopting the technical scheme of the embodiment of the invention, the current state of the food material is obtained through the cloud server based on the image data analysis, and the AR display content is determined according to the current state; the AR display content comprises manufacturing steps and/or modification suggestions which are adaptive to the current state of food materials, so that the user is effectively helped to perform food manufacturing better through the novel interaction mode of the AR, if better shaping manufacturing guidance of baking food is provided for the user, the user can obtain more timely manufacturing effect feedback, and the use experience of the user is greatly improved.
Example two
An embodiment of the present invention provides a control method, where the control method in this example is applied to a server side, as shown in fig. 2, the control method mainly includes the following steps:
step 201: and receiving the image data of the food material entering the preset production stage, which is sent by the terminal.
In this embodiment, the predetermined manufacturing stage represents a shaping processing stage, such as a shaping processing stage, performed on the food material.
For example, when it is detected that a bread or cake shaping step is entered, the terminal sends image data of dough about to enter the shaping step to the server.
In this embodiment, the server may be a cloud server, and certainly, the server may also be a common server.
Step 202: and analyzing the current state of the food material based on the image data.
Wherein the current state includes, but is not limited to:
shape, size, color, etc. of the food material.
Step 203: determining AR display content according to the current state; wherein the AR display content comprises a production step and/or a modification suggestion which are adapted to the current state of the food material.
In some optional embodiments, the determining AR presentation content according to the current state comprises:
obtaining a predicted finished product effect according to the current state information of the food material;
judging the difference between the predicted finished product effect and the target finished product effect to obtain a judgment result;
and determining a manufacturing step and/or a modification suggestion which are suitable for the current state of the food material according to the judgment result.
Here, the target end product effect is an end product effect in the target recipe.
For example, the server recommends shaping suggestions to the user that are appropriate to the current state of the dough based on the current state of the dough. Specifically, assuming that the user is to make a bun, and the standard bun has 3 shapes, the server recommends one or two of the three shapes to the user, the recommended one or two being compatible with the current state of the dough.
For another example, the server predicts that the finished pineapple bag manufactured under the current dough state is twice or three times of the pineapple bag with the common specification according to the current state of the dough; if the pineapple bread standard with the common specification size is achieved, the dough needs to be divided into two or three, and accordingly, the server provides modification suggestions to the user to divide the dough into two or three.
For another example, the server predicts that the color degree of the finished butter bread made in the current dough state is not transparent enough according to the current state of the dough; in order to meet the butter bread standard of the target specification, the server presents the user with a manufacturing step of further coating the dough with a layer of butter.
Step 204: and returning the AR display content to the terminal, and making food materials by the user according to the AR display content output by the terminal.
So, through AR's novel interactive mode, help the user to carry out food preparation better more effectively, if provide better baked food plastic preparation to the user and guide, can also let the user obtain more timely preparation effect feedback, promoted user's use greatly and experienced.
Further, before step 201, the method may further include:
step 200a (not shown in fig. 1): and receiving a recipe list acquisition request sent by the terminal.
Step 200b (not shown in fig. 1): and returning the recipe list to the terminal based on the recipe list acquisition request.
Step 200c (not shown in fig. 1): and receiving a target recipe content downloading request sent by a terminal, wherein the target recipe is selected from the recipe list by a user.
Step 200d (not shown in fig. 1): and returning the target recipe content to the terminal based on the target recipe content downloading request.
The target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
Therefore, the user can conveniently prepare food materials according to the target recipe content, such as food material weighing, preprocessing and other operations until the previous stage of the preset preparation stage is completed.
By adopting the technical scheme of the embodiment, the current state of the food material is obtained through the cloud server based on the image data analysis, and the AR display content is determined according to the current state; wherein, AR show content includes the preparation step and/or the transformation suggestion that suit with the current state of eating the material, so, through AR's novel interactive mode, helps the user to carry out food preparation better more effectively, if provide better baked food plastic preparation guide to the user, can also let the user obtain more timely preparation effect feedback, has promoted user's use greatly and has experienced.
EXAMPLE III
Fig. 3 is a schematic diagram of an implementation process of providing bread shaping guidance for a user according to an embodiment of the present invention, and as shown in fig. 3, the process mainly includes the following steps:
step 301: the terminal receives an operation of opening a first application by a user, and sends a recipe list acquisition request to the server based on the operation.
Here, the first application can provide a recipe list and can perform task allocation such as a food material processing task, a weighing task, and the like. The first application can also receive and display AR display content returned by the server.
The terminal is provided with a first application, and the first application may be an application carried by the terminal or an application downloaded from an application store.
In this embodiment, the terminal includes, but is not limited to, a mobile phone or a tablet computer.
Specifically, the user opens a first application (App) on the terminal, which retrieves a recipe list from the server.
Wherein the recipe list includes, but is not limited to: recipe picture, title, preparation time, etc.
Step 302: and the terminal receives the recipe list returned by the server, and when receiving the operation of selecting the target recipe by the user, sends a target recipe content downloading request to the server based on the operation.
Specifically, after the terminal receives the recipe list returned by the server, the first application presents the recipe list, the user confirms the target recipe to be made by browsing, and after clicking to open, the first application requests to download the detailed content of the target recipe from the server, where the detailed content includes but is not limited to: the AR of the recipe shows teaching contents, steps, pictures, introduction, food material lists and the like.
Step 303: and the user starts to make the target recipe according to the content of the target recipe until finishing the steps before shaping.
Specifically, the user starts to make the food according to the displayed content of the recipe, for example, the food weighing, preprocessing and other operations are performed until the steps before shaping are completed.
Step 304: when the terminal detects that the user is made to the shaping step, the first application outputs prompt information.
And the prompt information is used for prompting the user whether to start an AR teaching mode.
Specifically, when the terminal detects that the next step is the shaping step, the first application pops up a prompt for indicating that the AR teaching mode is to be entered. Here, the prompting means includes, but is not limited to, voice prompt or text prompt.
Step 305: the first application opens the camera of the terminal, and the user aims the camera of the terminal at the food material to be shaped according to the prompt.
Specifically, when entering VR teaching mode, the permission of terminal camera is transferred to first application, opens the camera to the suggestion user aims at the edible material that is about to enter the plastic step.
Fig. 4 shows a schematic diagram of the dough aligned by the camera when entering the VR teaching mode, the left diagram in fig. 4 shows a schematic diagram of the dough on the workbench, and the right diagram in fig. 4 shows an image of the dough obtained after the camera is aligned with the dough.
Step 306: and the camera on the terminal acquires the real-time image and uploads the real-time image to the server so as to acquire the AR display content provided by the server according to the current state of the dough.
Specifically, the camera acquires a real-time image and uploads the real-time image to the server, and the server recommends how a user shapes (such as the shape of a ox horn bag) according to the current state of food materials and sends related AR display contents to the terminal.
Step 307: and the user shapes the dough according to the AR display content output by the terminal.
Specifically, a first application on a terminal displays contents of AR teaching, wherein the contents of the AR teaching comprise explanation, a shaping process, text prompt and the like, and related help information is provided on an interface; meanwhile, the user can compare the shape presented on the terminal with the actual food material shape, and the first application judges whether the shaping effect is appropriate or not in real time or whether the shaping effect needs to be adjusted or not.
Here, the determination of whether the shaping effect is appropriate or whether an adjustment is required may also be determined by the server.
Therefore, the recipe making teaching can be carried out in an AR mode, the related teaching information is presented on a terminal interface, and the recipe making can be instantly contrasted with the food material making in the AR mode to confirm whether the effect is met; this kind of novel interactive mode through AR helps the user to cook better more effectively, lets the user obtain more timely preparation effect feedback, has improved user experience greatly.
Example four
An embodiment of the present invention provides a control device, fig. 5 is a schematic diagram illustrating a structure of the control device according to the embodiment of the present invention, where the control device is applied to a terminal, and the terminal can communicate with a server, as shown in fig. 5, the control device includes:
a first processing unit 51, configured to detect whether the food material enters a predetermined preparation stage;
the output unit 52 is configured to output a prompt message when the processing unit detects that the food material enters a predetermined preparation stage; the prompting information is used for prompting the user whether to start an AR teaching mode;
a collecting unit 53, configured to collect an image of the food material if the first processing unit determines to start the AR teaching mode,
a first communication unit 54, configured to send the acquired image data to a server; receiving AR display content determined by the server based on the image data; wherein the AR display content comprises production steps and/or modification suggestions given for a current state of the food material, the current state being obtained based on the image data analysis;
the output unit 52 is further configured to output the AR display content, so that the user refers to the AR display content to produce food materials.
As an embodiment, the first communication unit 54 is further configured to send a recipe list acquisition request to the server;
the first processing unit 51 is further configured to select a target recipe from the recipe list;
the first communication unit 54 is further configured to send the target recipe content download request to the server; receiving the target recipe content returned by the server, and making food materials by a user according to the target recipe content until the preset making stage is completed;
the target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
It should be understood by those skilled in the art that the functions of the modules in the control device of the present embodiment can be understood by referring to the foregoing description of the control method applied to the terminal side.
Illustratively, the first communication unit 54 may be implemented by a bluetooth module, a WIFI module, an infrared module, a mobile data module, or the like.
Illustratively, the output unit 52 may be implemented by a display interaction module or a voice interaction module, etc.
Illustratively, the acquisition unit 53 may be implemented by a camera or the like.
In practical applications, the specific structure of the first processing unit 51 may correspond to a processor. The specific structure of the processor may be an electronic component or a collection of electronic components having a Processing function, such as a Central Processing Unit (CPU), a Micro Controller Unit (MCU), a Digital Signal Processor (DSP), or a Programmable Logic Controller (PLC). The processor includes executable codes, the executable codes are stored in a storage medium, the processor can be connected with the storage medium through a communication interface such as a bus, and when the corresponding functions of specific units are executed, the executable codes are read from the storage medium and executed. The storage medium is preferably a non-transitory storage medium for storing the portion of the executable code. Wherein the executable code is used for executing the control method of the embodiment applied to the terminal side.
The control device can perform recipe making teaching in an AR manner, present related teaching information on a terminal interface, and confirm whether the effect is satisfied by instant comparison with food material making in the AR manner; this kind of through AR's novel interactive mode, more effective help user cooks better, lets the user obtain more timely preparation effect feedback, has improved user experience greatly.
EXAMPLE five
An embodiment of the present invention provides a control device, fig. 6 is a schematic diagram of a composition structure of the control device provided in the embodiment of the present invention, and is applied to a server, as shown in fig. 6, the control device includes:
the second communication unit 61 is used for receiving the image data of the food material entering the preset making stage, which is sent by the terminal;
the second processing unit 62 is configured to analyze the current state of the food material based on the image data; determining AR display content according to the current state; wherein the AR display content comprises a making step and/or a modification suggestion which are adapted to the current state of the food material;
the second communication unit 61 is further configured to return the AR display content to the terminal, so that the user refers to the AR display content output by the terminal to make the food material.
As an implementation manner, the second communication unit 61 is further configured to receive a recipe list acquisition request sent by a terminal; returning a recipe list to the terminal based on the recipe list acquisition request; receiving a target recipe content downloading request sent by a terminal, wherein the target recipe is selected from the recipe list; returning the target recipe content to the terminal based on the target recipe content downloading request;
the target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
As an embodiment, the second processing unit 62 is further configured to:
obtaining a predicted finished product effect according to the current state of the food material, wherein the current state comprises the current shape and/or size of the food material;
judging the difference between the predicted finished product effect and the target finished product effect to obtain a judgment result;
and determining a manufacturing step and/or a modification suggestion which are adapted to the current state of the food material according to the judgment result.
It should be understood by those skilled in the art that the functions of the modules in the control device of the present embodiment can be understood by referring to the related description of the control method applied to the server side.
Illustratively, the second communication unit 61 may be implemented by a bluetooth module, a WIFI module, an infrared module, a mobile data module, or the like.
In practical applications, the specific structure of the second processing unit 62 may correspond to a processor. The specific structure of the processor can be an electronic component or a collection of electronic components with processing functions, such as a CPU, an MCU, a DSP or a PLC. The processor includes executable codes, the executable codes are stored in a storage medium, the processor can be connected with the storage medium through a communication interface such as a bus, and when the corresponding functions of specific units are executed, the executable codes are read from the storage medium and executed. The portion of the storage medium used to store the executable code is preferably a non-transitory storage medium. Wherein the executable code is used for executing the control method applied to the embodiment in the server side.
The control device of the embodiment can perform recipe making teaching in an AR mode and display related teaching information on a terminal interface; the food material can be compared with the food material in an AR manner in real time to determine whether the expected effect is met; this kind of through AR's novel interactive mode, effectively help the user to carry out food preparation better, let the user in time obtain the preparation effect feedback, improved user experience greatly.
Example six
An embodiment of the present invention provides a control system, fig. 7 is a schematic composition diagram of the control system provided in the embodiment of the present invention, and as shown in fig. 7, the control system includes: a terminal and a server; wherein the content of the first and second substances,
the terminal is used for outputting prompt information when detecting that the food material enters a preset making stage; the prompting information is used for prompting the user whether to start an AR teaching mode; if the AR teaching mode is determined to be started, acquiring an image of the food material, and sending acquired image data to a server; receiving AR display content determined by the server based on the image data; the AR display content comprises a making step and/or a modification suggestion which are adaptive to the current state of the food material, and the current state is obtained based on the image data analysis; outputting the AR display content to enable a user to make food materials by referring to the AR display content;
the server is used for receiving the image data of the food materials entering the preset making stage, which are sent by the terminal; analyzing the current state of the food material based on the image data; determining AR display content according to the current state; wherein the AR display content comprises a making step and/or a modification suggestion which are adapted to the current state of the food material; and returning the AR display content to the terminal.
The control system can perform recipe making teaching in an AR mode and present related teaching information on a terminal interface; the food material can be compared with the food material in an AR manner in real time to determine whether the expected effect is met; this kind of through AR's novel interactive mode, effectively help the user to carry out food preparation better, let the user in time obtain the preparation effect feedback, improved user experience greatly.
For example, in the baking process of a user, when food materials enter a preset making stage, a terminal collects food material images and sends collected image data to a server; the server analyzes the current state of the food material based on the image data; determining a manufacturing step corresponding to the current state of the food material and/or reconstructing suggested AR display content according to the current state; the server sends the AR display content to the terminal for display by the terminal, so that the baking is simple, scientific and reasonable, and the method is beneficial for a user to make more delicious, more nutritional and more beautiful food according to the AR display content.
The embodiment of the present invention further describes a computer storage medium, in which computer-executable instructions are stored, and the computer-executable instructions are used for executing the control method described in each of the foregoing embodiments. That is, after the computer executable instruction is executed by the processor, the control method provided by any one of the foregoing technical solutions can be implemented.
It should be understood by those skilled in the art that the functions of the programs in the computer storage medium of the present embodiment can be understood by referring to the description related to the control method described in the foregoing embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (11)
1. A baking control method applied to a terminal side, the method comprising:
when the food materials are detected to enter a preset making stage, outputting prompt information; the prompting information is used for prompting the user whether to start an AR teaching mode; the predetermined manufacturing stage represents a shaping processing stage in the baking process; the food material is dough;
if the AR teaching mode is determined to be started, acquiring an image of the food material, and sending acquired image data to a server;
receiving AR display content determined by the server based on the image data; wherein the AR display content comprises production steps and/or modification suggestions given for a current state of the food material, the current state being obtained based on the image data analysis; the manufacturing steps and/or retrofit recommendations comprise: a shaping recommendation is obtained based on the difference between the predicted finished product effect and the target finished product effect; the predicted finished product effect is obtained according to the current state;
and outputting the AR display content so that the user can make food materials by referring to the AR display content.
2. The method of claim 1, further comprising:
sending a recipe list acquisition request to a server;
selecting a target recipe from the recipe list;
sending the target recipe content downloading request to the server;
receiving the target recipe content returned by the server, and making food materials by a user according to the target recipe content until the preset making stage is completed;
the target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
3. A baking control method is applied to a server side, and is characterized by comprising the following steps:
receiving image data of food materials entering a preset making stage, which are sent by a terminal; the predetermined manufacturing stage represents a shaping processing stage in the baking process; the food material is dough;
analyzing the current state of the food material based on the image data;
determining AR display content according to the current state; wherein the AR display content comprises a making step and/or a modification suggestion which are adapted to the current state of the food material; the manufacturing steps and/or retrofit recommendations comprise: a shaping recommendation is obtained based on the difference between the predicted finished product effect and the target finished product effect; the predicted finished product effect is obtained according to the current state;
and returning the AR display content to the terminal, and making food materials by the user according to the AR display content output by the terminal.
4. The method of claim 3, further comprising:
receiving a recipe list acquisition request sent by a terminal;
returning a recipe list to the terminal based on the recipe list acquisition request;
receiving a target recipe content downloading request sent by a terminal, wherein the target recipe is selected from the recipe list;
returning the target recipe content to the terminal based on the target recipe content downloading request;
the target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
5. The method of claim 3, wherein said determining AR presentation content based on said current state comprises:
obtaining a predicted finished product effect according to current state information of the food materials, wherein the current state comprises the current shape and/or size of the food materials;
judging the difference between the predicted finished product effect and the target finished product effect to obtain a judgment result;
and determining a manufacturing step and/or a modification suggestion which are suitable for the current state of the food material according to the judgment result.
6. A bake control apparatus applied to a terminal side, the control apparatus comprising:
the first processing unit is used for detecting whether the food material enters a preset making stage or not; the predetermined manufacturing stage represents a shaping processing stage in the baking process; the food material is dough;
the output unit is used for outputting prompt information when the processing unit detects that the food material enters a preset making stage; the prompting information is used for prompting the user whether to start an AR teaching mode;
a collecting unit for collecting the images of the food materials if the first processing unit determines to start the AR teaching mode,
the first communication unit is used for sending the acquired image data to the server; receiving AR display content determined by the server based on the image data; the AR display content comprises manufacturing steps and/or modification suggestions given according to the current state of the food material, and the current state is obtained based on the image data analysis; the manufacturing steps and/or retrofit recommendations comprise: a shaping recommendation is obtained based on the difference between the predicted finished product effect and the target finished product effect; the predicted finished product effect is obtained according to the current state;
the output unit is further configured to output the AR display content, so that the user makes food materials by referring to the AR display content.
7. The apparatus of claim 6,
the first communication unit is also used for sending a recipe list acquisition request to the server;
the first processing unit is further used for selecting a target recipe from the recipe list;
the first communication unit is further used for sending the target recipe content downloading request to the server; receiving the target recipe content returned by the server, and making food materials by a user according to the target recipe content until the preset making stage is completed;
the target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
8. A baking control device applied to a server is characterized by comprising:
the second communication unit is used for receiving the image data of the food material entering the preset making stage, which is sent by the terminal; the predetermined manufacturing stage represents a shaping processing stage in the baking process; the food material is dough;
the second processing unit is used for analyzing and obtaining the current state of the food material based on the image data; determining AR display content according to the current state; wherein the AR display content comprises a making step and/or a modification suggestion which are adapted to the current state of the food material; the manufacturing steps and/or retrofit recommendations comprise: a shaping recommendation is obtained based on the difference between the predicted finished product effect and the target finished product effect; the predicted finished product effect is obtained according to the current state;
the second communication unit is further configured to return the AR display content to the terminal, so that the user refers to the AR display content output by the terminal to make the food material.
9. The apparatus of claim 8,
the second communication unit is also used for receiving a recipe list acquisition request sent by the terminal; returning a recipe list to the terminal based on the recipe list acquisition request; receiving a target recipe content downloading request sent by a terminal, wherein the target recipe is selected from the recipe list; returning the target recipe content to the terminal based on the target recipe content downloading request;
the target recipe content includes, but is not limited to, recipe production steps, pictures, presentations, and food material lists.
10. The apparatus of claim 8,
the second processing unit is further configured to obtain a predicted finished product effect according to a current state of the food material, where the current state includes a current shape and/or size of the food material; judging the difference between the predicted finished product effect and the target finished product effect to obtain a judgment result; and determining a manufacturing step and/or a modification suggestion which are suitable for the current state of the food material according to the judgment result.
11. A torrefaction control system, comprising:
the terminal is used for outputting prompt information when detecting that the food materials enter a preset manufacturing stage; the prompting information is used for prompting the user whether to start an AR teaching mode; the predetermined manufacturing stage represents a shaping processing stage in the baking process; the food material is dough; if the AR teaching mode is determined to be started, acquiring images of the food materials, and sending acquired image data to a server; receiving AR display content determined by the server based on the image data; the AR display content comprises making steps and/or transformation suggestions which are adaptive to the current state of the food material, and the current state is obtained based on the image data analysis; outputting the AR display content to enable a user to make food materials by referring to the AR display content; the manufacturing steps and/or retrofit recommendations comprise: a shaping recommendation is obtained based on the difference between the predicted finished product effect and the target finished product effect; the predicted finished product effect is obtained according to the current state;
the server is used for receiving the image data of the food material entering the preset making stage, which is sent by the terminal; analyzing the current state of the food material based on the image data; determining AR display content according to the current state; wherein the AR display content comprises a making step and/or a modification suggestion which are adapted to the current state of the food material; and returning the AR display content to the terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910214823.7A CN111722543B (en) | 2019-03-20 | 2019-03-20 | Baking control method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910214823.7A CN111722543B (en) | 2019-03-20 | 2019-03-20 | Baking control method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111722543A CN111722543A (en) | 2020-09-29 |
| CN111722543B true CN111722543B (en) | 2022-09-20 |
Family
ID=72562110
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910214823.7A Active CN111722543B (en) | 2019-03-20 | 2019-03-20 | Baking control method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111722543B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114167801B (en) * | 2021-12-06 | 2022-07-08 | 中成卓越(北京)厨房设备有限公司 | Kitchen equipment management system based on linkage control |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104246375A (en) * | 2012-05-08 | 2014-12-24 | 伊莱克斯家用产品股份有限公司 | Appliance for processing food and method of operating the same |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102324199B1 (en) * | 2015-01-28 | 2021-11-11 | 삼성전자주식회사 | Cooking apparatus and control method of cooking apparatus |
| CN106254552A (en) * | 2016-09-30 | 2016-12-21 | 佛山市顺德区美的电热电器制造有限公司 | Recipe methods of exhibiting, recipe display systems and smart machine |
| CN106774874B (en) * | 2016-12-12 | 2020-01-21 | 快创科技（大连）有限公司 | Cooking auxiliary system based on AR augmented reality technology and based on color evaluation |
| KR102435186B1 (en) * | 2017-08-31 | 2022-08-24 | 삼성전자주식회사 | Cooking apparatus and Cooking system |
| CN109299293A (en) * | 2018-08-23 | 2019-02-01 | 百度在线网络技术（北京）有限公司 | Cooking tip method, apparatus, equipment and storage medium for AR scene |
-
2019
- 2019-03-20 CN CN201910214823.7A patent/CN111722543B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104246375A (en) * | 2012-05-08 | 2014-12-24 | 伊莱克斯家用产品股份有限公司 | Appliance for processing food and method of operating the same |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111722543A (en) | 2020-09-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN204698314U (en) | A kind of intelligent kitchen cooking system | |
| CN111596563B (en) | Intelligent smoke kitchen system and cooking guiding method thereof | |
| SE544194C2 (en) | Meal preparation orchestrator | |
| US20170188741A1 (en) | Method and System for Acquiring Cooking Information | |
| CN106264065A (en) | A kind of intelligent kitchen cooking system and the method for intelligence auxiliary cooking | |
| CN106791392B (en) | Food information acquisition method and device and terminal | |
| CN105979832B (en) | Kitchen appliance with contactless operation | |
| EP2898799A1 (en) | Cooking system with assisted use | |
| CN105426402A (en) | Social networking system and method applied to cooking | |
| WO2019000988A1 (en) | Recipe recommendation method, device and system, storage medium and computer device | |
| CN110840222A (en) | Cooking parameter adjusting method, cooking robot and computer readable storage medium | |
| CN106453545A (en) | Recipe showing and interacting method and system, and intelligent device | |
| CN111722543B (en) | Baking control method, device and system | |
| CN106254552A (en) | Recipe methods of exhibiting, recipe display systems and smart machine | |
| CN113039575A (en) | Information processing apparatus, information processing method, and program | |
| CN110680201A (en) | Network system, server, and information processing method | |
| CN109698776B (en) | Information management method for refrigerator | |
| CN110716472A (en) | Method and device for creating electronic menu, electronic equipment and storage medium | |
| CN110613314B (en) | Cooking prompting method and device and storage medium | |
| CN110579985A (en) | control method, device and system | |
| CN109448132B (en) | Display control method and device, electronic equipment and computer readable storage medium | |
| CN110575075B (en) | Control method, equipment and system | |
| CN110580011A (en) | control method and device | |
| CN112394149A (en) | Food material maturity detection prompting method and device and kitchen electrical equipment | |
| CN112099372A (en) | Menu generation method and device, cooking equipment, mobile terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |