WO2020125475A1 - Auxiliary cooking method, household appliance, and computer storage medium - Google Patents

Auxiliary cooking method, household appliance, and computer storage medium Download PDF

Info

Publication number
WO2020125475A1
WO2020125475A1 PCT/CN2019/124116 CN2019124116W WO2020125475A1 WO 2020125475 A1 WO2020125475 A1 WO 2020125475A1 CN 2019124116 W CN2019124116 W CN 2019124116W WO 2020125475 A1 WO2020125475 A1 WO 2020125475A1
Authority
WO
WIPO (PCT)
Prior art keywords
cooking
user
recipe data
voice
information
Prior art date
Application number
PCT/CN2019/124116
Other languages
French (fr)
Chinese (zh)
Inventor
徐小峰
张晨
王一舒
涂建华
Original Assignee
广东美的白色家电技术创新中心有限公司
美的集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广东美的白色家电技术创新中心有限公司, 美的集团股份有限公司 filed Critical 广东美的白色家电技术创新中心有限公司
Publication of WO2020125475A1 publication Critical patent/WO2020125475A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/04Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/042Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
    • G05B19/0423Input/output
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/26Pc applications
    • G05B2219/2643Oven, cooking

Definitions

  • the present application relates to the field of smart home appliances, in particular to an auxiliary cooking method, home appliance equipment and computer storage media.
  • Smart home appliances are becoming more and more intelligent. Smart home appliances are widely used in people's lives. For example, smart home appliances can be equipped with functions to assist users in cooking. However, the current cooking assistance methods are only Smart home appliances can provide users with a fixed-format viewable recipe text, play a fixed-format cooking video, or broadcast a fixed-format cooking step. It is impossible to provide intelligent cooking guidance for information on the cooking site.
  • the present application provides an auxiliary cooking method, a home appliance, and a computer storage medium to solve the problem that the existing auxiliary cooking method cannot implement intelligent cooking guidance for information on the cooking site.
  • the present application provides an auxiliary cooking method, which includes: monitoring a cooking site to obtain user cooking information; matching user cooking information and preset recipe data to generate cooking suggestions; and presenting cooking suggestions.
  • the present application provides a household electrical appliance, which includes a processor and a memory, and a computer program is stored in the memory, and the processor is used to execute the computer program to implement the steps of the above-mentioned auxiliary cooking method.
  • the present application provides a computer storage medium in which a computer program is stored, and when the computer program is executed, the steps of the above-mentioned auxiliary cooking method are realized.
  • the cooking site is monitored to obtain the user's cooking information, and the user's cooking information is matched with the recipe data to generate cooking suggestions, and then the cooking suggestions are presented.
  • cooking suggestions can be given based on the cooking information of the user on the cooking site to achieve more intelligent cooking assistance and truly guide the user in the cooking process.
  • FIG. 1 is a schematic flowchart of a first embodiment of an assisted cooking method of the present application
  • FIG. 2 is a schematic flowchart of a second embodiment of an assisted cooking method of the present application.
  • FIG. 3 is a schematic flowchart of a third embodiment of an assisted cooking method of the present application.
  • FIG. 4 is a schematic flowchart of a fourth embodiment of an assisted cooking method of the present application.
  • FIG. 5 is a schematic structural diagram of an embodiment of a home appliance device of the present application.
  • FIG. 6 is a schematic structural diagram of an embodiment of a computer storage medium of the present application.
  • the assisted cooking method of the present application realizes is to promptly guide the user's cooking process in the cooking process, and the effect achieved is similar to the situation in which a cooking expert guides cooking on the spot, that is, real intelligence is realized Cooking assistance.
  • This application emphasizes timeliness and pertinence, and is different from the current auxiliary method of pre-demonstrating the cooking process, which can give cooking suggestions according to the user's cooking situation at any time to assist the user in the entire cooking process. It is particularly suitable for the cooking process of Chinese dishes, such as the quick-fry cooking process, which requires high timeliness of cooking assistance. This application can provide real-time cooking suggestions.
  • FIG. 1 is a schematic flowchart of the first embodiment of the auxiliary cooking method of the present application.
  • the auxiliary cooking method of this embodiment includes the following steps.
  • S101 Monitor the cooking scene to obtain user cooking information.
  • What this embodiment implements is targeted cooking assistance in the cooking process, so the cooking site is first monitored, that is, when the user is cooking, the user, dishes, cookware, etc. in the cooking site are monitored to know the cooking situation, Therefore, different cooking suggestions should be given for different cooking situations.
  • the cooking site is monitored by the opened monitoring device.
  • the monitoring device may be an input device microphone, camera, sensor, etc.
  • the microphone can monitor the voice of the cooking site
  • the camera can monitor the image of the cooking site
  • the sensor can The temperature sensor and the odor sensor can detect the temperature or smell of the dishes on the cooking site.
  • a monitoring device is used to monitor the cooking site, and the user's cooking information can be further obtained.
  • the user's cooking information indicates the user's voice at the cooking site and relates to the user's cooking related inquiry; the cooking image relates to the current cooking state; Information related to the current dish status. According to these user cooking information, auxiliary cooking can be carried out in a targeted manner.
  • S102 Match user cooking information and preset recipe data to generate cooking suggestions.
  • the user's cooking information is matched with the preset recipe data, thereby generating cooking suggestions for the user's cooking information.
  • the process of this step S102 is specifically: determining a data tag related to the user's cooking information in the recipe data, and generating a cooking suggestion according to the data identified by the determined data tag.
  • the recipe data in this embodiment is preset, and multiple data tags are included in the recipe data to match user cooking information. Further, in order to be able to match various types of user cooking information, multi-dimensional data labels are also set in the recipe data to support the matching of various types of user cooking information and the generation of related cooking suggestions.
  • the data labels in the recipe data may include step labels, raw material labels, action labels, control labels, and the like.
  • the data identified by the step label can be the specific content of the cooking step
  • the data identified by the raw material label can be the amount of specific ingredients
  • the data identified by the action label can be the specific requirements of the cooking action
  • the data identified by the control label can be The controlled fire is waiting.
  • the recipe is as follows.
  • Raw materials 300g pork, 100g water magnolia slices, 100g water fungus, pickled pepper, ginger, green onion, garlic, soy sauce, balsamic vinegar, wine, starch, salt, sugar, broth;
  • the first step pork, magnolia slices, shredded fungus
  • Step 2 Shred the pork, magnolia slices and fungus in a bowl, add salt, wine and wet starch and mix well;
  • the third step finely chopped pickled pepper, mix with sugar, balsamic vinegar, soy sauce, starch, broth into sweet and sour sauce;
  • the fourth step Place the wok on the fire, heat it for 1 minute, the oil is burned to 60% heat;
  • Step 5 Add the well-mixed pork, magnolia slices and wood ears, stir fry for 1 minute;
  • Step 6 Add ginger, spring onion, garlic and stir fry, stir fry;
  • Step 7 Add sweet and sour sauce, stir-fry for 2 minutes, and turn it over a few times.
  • the step label in the preset recipe data can be "first step”, etc.
  • the corresponding “first step” identifies the data as “pork, magnolia slices, shredded fungus”
  • the raw material label can be “ "Pork”
  • the marked data is "300g”
  • the action label can be “fried”
  • the marked data is "1 minute”
  • the control label can be "Fire”
  • the marked data is "Wang Huo” ".
  • the recipe data is refined and identified by data tags; therefore, the data tags and the user's cooking information can be compared to determine the relevant data tags, that is, the relevant data; and then cooking suggestions can be generated based on the relevant data.
  • the relevant data tags that is, the relevant data
  • cooking suggestions can be generated based on the relevant data.
  • the user's cooking information is the user's voice and the user's voice is "how to cut pork?"
  • the corresponding action label "cut pork” and the data "cutting” identified by the action label can be found, and then the user voice can be targeted.
  • cooking suggestions are generated based on the same process.
  • the preset recipe data in this embodiment may be not only the above text recipe data but also video recipe data.
  • the same data label may be used, and the data label is in the video recipe data
  • the one identified in can be a video segment.
  • the generated cooking suggestion may be based on textual recipe data or video recipe data.
  • the generated cooking suggestion may be cutting pork Silk video segment.
  • the presentation method may be voice broadcast cooking suggestions or video display cooking suggestions, wherein the voice broadcast cooking suggestions are mainly based on text recipe data, and the video display cooking suggestions are mainly based on video recipe data.
  • the cooking site is monitored, and then the user's cooking information is obtained, real-time auxiliary cooking can be realized, the user's cooking information is matched with the preset recipe data, thereby generating cooking suggestions, and presenting the cooking suggestions for the monitored
  • the user's cooking information assists the user in cooking.
  • intelligent voice interaction with the user can be implemented to assist the user in cooking.
  • voice-related inquiries can be issued at any time.
  • the user's voice is monitored After that, you can respond to the user's voice and give cooking suggestions.
  • FIG. 2 is a schematic flowchart of a second embodiment of the auxiliary cooking method of the present application.
  • the auxiliary cooking method of this embodiment includes the following steps.
  • S201 Monitor the cooking scene to obtain user voice.
  • This embodiment is based on the embodiment shown in FIG. 1, that is, the content of the embodiment shown in FIG. 1 can be applied to this embodiment.
  • this embodiment responds to cooking suggestions for the user voice of the cooking site, and monitors in this step S201 The sound of the cooking scene, and then obtain the user's voice.
  • the acquired user voice can be enhanced, which can be implemented in hardware or software.
  • a software enhancement method is used to process the user voice, thereby enhancing the quality of the user voice.
  • the user voice acquired by monitoring the cooking site is audio data, and the audio data needs to be processed to semantically understand the user voice to obtain the intention expressed by the user voice.
  • the cooking intention is obtained. .
  • the user's voice is understood based on natural language understanding technology to obtain cooking intentions.
  • ASR Automatic Speech Recognition
  • NLU Natural Language Understanding
  • S203 Match cooking intention and recipe data to generate cooking suggestions.
  • the cooking intention can be matched with the recipe data to generate cooking suggestions.
  • the matching process is similar to that in the embodiment shown in FIG. 1, and details are not repeated here.
  • the manner of voice broadcast of the cooking suggestion also involves the process of language generation (Natural Language Generation, NLG) and voice broadcast (Text to Speech, TTS). That is, after understanding the cooking intentions and generating cooking suggestions, it is also necessary to generate language texts imitating human expressions based on the cooking suggestions, and convert the language texts into speech for broadcasting to answer the user's voice.
  • language generation Natural Language Generation, NLG
  • voice broadcast Text to Speech, TTS
  • This embodiment can promptly answer the user's voice query during cooking, thereby assisting the user in cooking.
  • the embodiment shown in FIG. 2 it is applicable to a case where the user voice can determine corresponding specific data in the recipe data to generate cooking suggestions.
  • the embodiment shown in FIG. 3 is used to implement assisted cooking, for example, when the user asks “what to do next”, although the user’s cooking intention can be recognized as wanting to know the next cooking step , But the user has not provided the current cooking status, that is, it is not sure which cooking step is currently in, and therefore cannot give advice on the next cooking step.
  • FIG. 3 is a schematic flowchart of a third embodiment of the assisted cooking method of the present application.
  • the assisted cooking method of this embodiment includes the following steps.
  • S301 Monitor the cooking scene to obtain user voice.
  • S302 Analyze the user's voice to obtain cooking intentions.
  • the cooking intention can be matched with the recipe data first. If the matching is not possible, the cooking image of the cooking scene is actively acquired to determine the current cooking situation, so that the cooking recommendation can be given in time according to the current cooking situation.
  • the method adopted in this embodiment is to actively obtain the cooking situation of the cooking site, rather than confirming the cooking situation with the user through querying when the match cannot be obtained. Compared with querying the user, the method adopted in this embodiment is more Humanization and intelligence.
  • the way to obtain the cooking situation of the cooking scene is to obtain the cooking image.
  • the current cooking situation is obtained by recognizing the image of the cooking scene, that is, the cooking image is analyzed to obtain the cooking status.
  • step S303 a plurality of multi-directional cooking images can be obtained.
  • step S304 the multiple cooking images are identified, so that the cooking state can be obtained as accurately as possible.
  • S305 Match cooking intention, cooking state and recipe data to generate cooking suggestions.
  • the cooking intention, the cooking state and the recipe data are matched to generate a cooking suggestion, that is, the data label in the recipe data is determined according to the cooking intention and the cooking state, that is, the relevant data is determined, and the determined relevant data is determined You can generate cooking suggestions.
  • the user voice acquired in step S301 of this embodiment is "What next?" According to the user voice, the step label cannot be determined, so the cooking image in step S303 needs to be acquired.
  • step S304 the obtained cooking image is identified to determine the current cooking state. For example, if the cooking image shows that the user is mixing shredded pork, magnolia slices, and auricularia, the current cooking state can be determined according to the cooking image The second step.
  • step S305 the step label can be determined based on the current cooking state and cooking intention. Based on the above case, the determined step label is "third step”, and then the data "bubble” can be identified according to the step label "third step”. Chop the finely chopped pepper, and mix it with sugar, balsamic vinegar, soy sauce, starch, and broth to make sweet and sour sauce.”
  • the cooking image of the cooking scene is actively obtained to further confirm the user's cooking intentions according to the current cooking state, and then to give clear cooking suggestions.
  • This embodiment can respond to more user voice queries, make cooking assistance more intelligent, and improve user experience.
  • FIG. 4 is a schematic flowchart of a fourth embodiment of the auxiliary cooking method of the present application.
  • the auxiliary cooking method of this embodiment includes the following steps.
  • S401 Monitor the cooking scene to obtain cooking images.
  • This embodiment is based on the embodiment shown in FIG. 1, that is, the content of the embodiment shown in FIG. 1 can be applied to this embodiment.
  • the cooking situation at the cooking site is monitored, and cooking suggestions are actively given.
  • the cooking image of the cooking scene is acquired to know the cooking situation.
  • a cooking image is obtained, and generally a camera is used for shooting, and multiple images can be periodically taken, or continuous images and video shooting can also be taken.
  • the camera may include a normal camera and an infrared camera to assist recognition, so that the recognition is more accurate; algorithms can also be used to enhance the cooking image.
  • the cooking state may include the current cooking state and the cooking process state.
  • the current cooking state may include the dish state, the current cooking step, etc.; the cooking process state may include the previous one. How long is the interval between steps, how many actions did you wait.
  • the cooking suggestion can be given immediately, that is, directly go to step S404. For example, after determining the cooking status and learning the current cooking step, suggestions for the next cooking step can be given.
  • the cooking state may be judged first, and the cooking suggestion is only given when the user is abnormal in cooking, that is, step S403 is performed first.
  • S403 Determine whether the cooking state meets the cooking standard preset based on the recipe data.
  • the cooking standard is used to determine whether the cooking is abnormal, and the cooking standard is preset based on the recipe data.
  • the preset cooking standard may be exuberant , Heat for 1 minute, stir fry for 1 minute, etc.
  • step S404 is executed, that is, in response to the judgment result that the cooking state does not meet the cooking standard, step S404 is executed. That is, step S404 is executed after it is determined that the cooking state is abnormal. For example, when it is acquired according to the cooking image that the cooking state is medium fire, the cooking state does not meet the cooking standard, and then step S404 needs to be performed. When it is judged that the cooking state meets the cooking standard, the cooking advice is given wirelessly, and the process returns to step S401 to continue monitoring the cooking process.
  • S404 Match cooking status and recipe data to generate cooking suggestions.
  • step S404 the situation of step S404 is directly performed, specifically to match the cooking status and recipe data, determine the current cooking step, and then directly give cooking suggestions for the next cooking step.
  • step S402 After step S402 is completed, the situation of step S403 is performed. In the case where the cooking state is abnormal, the cooking state and recipe data are matched to give cooking suggestions in the normal cooking state.
  • the user's cooking process can also be monitored to assist the user in completing the cooking process according to the recipe data. Furthermore, abnormal conditions during the cooking process can be monitored, and cooking suggestions can be given in time to ensure that the user can complete the correct cooking process.
  • FIG. 5 is a schematic structural diagram of an embodiment of a home appliance in the present application.
  • the home appliance 100 in this embodiment includes an input device 11, a processor 12, a memory 13, and an output device 14.
  • the home appliance 100 can implement the above-mentioned embodiment of the auxiliary cooking method.
  • the memory 13 stores a computer program
  • the processor 12 is used to execute the computer program to implement the above-mentioned auxiliary cooking method.
  • the input device 11 is used to monitor the cooking scene and obtain user cooking information; the processor 12 is used to match the user cooking information and the recipe data preset in the memory 13 to generate cooking suggestions; the output device 14 is used to present cooking Suggest.
  • the processor 12 may be an integrated circuit chip with signal processing capability.
  • the processor 92 may also be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components .
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA off-the-shelf programmable gate array
  • the general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • the home appliance 100 may be a cooking-related home appliance.
  • the range hood is more commonly used. Therefore, when the user cooks, the home appliance hood performs intelligent assisted cooking.
  • the auxiliary cooking function can be set in commonly used household appliances, such as integrated kitchen workbenches.
  • the input device 11 may be a microphone or a camera, the microphone is used to obtain user voice, and the camera is used to obtain cooking images;
  • the output device 14 may be a display screen or a speaker, and the display screen is used to realize video Displaying cooking suggestions, the speaker is used to realize voice broadcast of cooking suggestions.
  • an array microphone can also be used as the input device 11 to implement sound pickup noise reduction and improve the signal-to-noise ratio to enhance the user's voice.
  • a greaseproof protective cover may be provided on the camera.
  • the processor 12 and the memory 13 in the home appliance 100 may also exist in the form of a server.
  • the home appliance 100 may include a communication device.
  • the home appliance 100 is connected to the server through the communication device, and the server 12 and the memory 13 are implemented through the server.
  • the server 12 and the memory 13 are implemented through the server.
  • FIG. 6 is a schematic structural diagram of an embodiment of the computer storage medium of this application .
  • the computer storage medium 200 stores a computer program 21, which can be executed to implement the method in the above embodiment.
  • the computer storage medium 200 may be a medium that can store program instructions, such as a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk, or an optical disk. Or, it may be a server that stores the program instructions, and the server may send the stored program instructions to other devices to run, or it may run the stored program instructions by itself.
  • program instructions such as a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk, or an optical disk.
  • ROM read-only memory
  • RAM Random Access Memory
  • the server may send the stored program instructions to other devices to run, or it may run the stored program instructions by itself.
  • the disclosed method and apparatus may be implemented in other ways.
  • the device implementation described above is only schematic.
  • the division of modules or units is only a division of logical functions.
  • there may be other divisions for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical, or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or software function unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the technical solution of the present application may be essentially or part of the contribution to the existing technology or all or part of the technical solution may be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the methods of the embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code .

Abstract

An auxiliary cooking method, a household appliance (100), and a computer storage medium (200). The auxiliary cooking method comprises: monitoring a cooking scene to obtain cooking information of a user (S101); performing matching between the cooking information of the user and preset menu data to generate a cooking suggestion (S102); and presenting the cooking suggestion (S103). According to the auxiliary cooking method, intelligent auxiliary cooking is carried out on the information of the cooking scene.

Description

辅助烹饪方法、家电设备及计算机存储介质Auxiliary cooking method, home appliance and computer storage medium
本申请要求于2018年12月19日提交的申请号为2018115577804,发明名称为“辅助烹饪方法、家电设备及计算机存储介质”的中国专利申请的优先权,其通过引用方式全部并入本申请。This application requires the priority of the Chinese patent application filed on December 19, 2018 with the application number 2018115577804 and the invention titled "Assisted Cooking Methods, Home Appliances, and Computer Storage Media", which is fully incorporated by reference into this application.
【技术领域】【Technical field】
本申请涉及智能家电领域,特别是涉及一种辅助烹饪方法、家电设备及计算机存储介质。The present application relates to the field of smart home appliances, in particular to an auxiliary cooking method, home appliance equipment and computer storage media.
【背景技术】【Background technique】
如今,家电设备越来越趋于智能化设计,智能家电在人们生活中得到了广泛的应用,例如可在智能家电上设置智能辅助用户烹饪的功能,而对此,当前的烹饪辅助方法均只是由智能家电向用户提供固定格式的可查看菜谱文本、播放固定格式的烹饪视频或播报固定格式的烹饪步骤,无法实现针对烹饪现场的信息进行智能的烹饪指导。Today, home appliances are becoming more and more intelligent. Smart home appliances are widely used in people's lives. For example, smart home appliances can be equipped with functions to assist users in cooking. However, the current cooking assistance methods are only Smart home appliances can provide users with a fixed-format viewable recipe text, play a fixed-format cooking video, or broadcast a fixed-format cooking step. It is impossible to provide intelligent cooking guidance for information on the cooking site.
【发明内容】[Invention content]
本申请提供一种辅助烹饪方法、家电设备及计算机存储介质,以解决现有的辅助烹饪方法无法实现针对烹饪现场的信息进行智能烹饪指导的问题。The present application provides an auxiliary cooking method, a home appliance, and a computer storage medium to solve the problem that the existing auxiliary cooking method cannot implement intelligent cooking guidance for information on the cooking site.
为解决上述技术问题,本申请提供一种辅助烹饪方法,其包括:监测烹饪现场进而获取用户烹饪信息;匹配用户烹饪信息和预设的菜谱数据以生成烹饪建议;呈现烹饪建议。In order to solve the above technical problems, the present application provides an auxiliary cooking method, which includes: monitoring a cooking site to obtain user cooking information; matching user cooking information and preset recipe data to generate cooking suggestions; and presenting cooking suggestions.
为解决上述技术问题,本申请提供一种家电设备,其包括处理器和存储器,存储器中存储有计算机程序,处理器用于执行计算机程序以实现上述辅助烹饪方法的步骤。In order to solve the above technical problems, the present application provides a household electrical appliance, which includes a processor and a memory, and a computer program is stored in the memory, and the processor is used to execute the computer program to implement the steps of the above-mentioned auxiliary cooking method.
为解决上述技术问题,本申请提供一种计算机存储介质,其中存储有计算机程序,计算机程序被执行时实现上述辅助烹饪方法的步骤。To solve the above technical problems, the present application provides a computer storage medium in which a computer program is stored, and when the computer program is executed, the steps of the above-mentioned auxiliary cooking method are realized.
本申请辅助烹饪方法中,对烹饪现场进行监测进而获得用户烹饪信息,将用户烹饪信息与菜谱数据进行匹配,从而生成烹饪建议,然后再呈现该烹饪建 议。通过本申请的方式,可基于烹饪现场的用户烹饪信息针对性的给出烹饪建议,以实现更为智能的烹饪辅助,真正实现对用户烹饪过程的指导。In the assisted cooking method of the present application, the cooking site is monitored to obtain the user's cooking information, and the user's cooking information is matched with the recipe data to generate cooking suggestions, and then the cooking suggestions are presented. Through the method of the present application, cooking suggestions can be given based on the cooking information of the user on the cooking site to achieve more intelligent cooking assistance and truly guide the user in the cooking process.
【附图说明】[Description of the drawings]
图1是本申请辅助烹饪方法第一实施例的流程示意图;FIG. 1 is a schematic flowchart of a first embodiment of an assisted cooking method of the present application;
图2是本申请辅助烹饪方法第二实施例的流程示意图;2 is a schematic flowchart of a second embodiment of an assisted cooking method of the present application;
图3是本申请辅助烹饪方法第三实施例的流程示意图;3 is a schematic flowchart of a third embodiment of an assisted cooking method of the present application;
图4是本申请辅助烹饪方法第四实施例的流程示意图;4 is a schematic flowchart of a fourth embodiment of an assisted cooking method of the present application;
图5是本申请家电设备一实施例的结构示意图;5 is a schematic structural diagram of an embodiment of a home appliance device of the present application;
图6是本申请计算机存储介质一实施例的结构示意图。6 is a schematic structural diagram of an embodiment of a computer storage medium of the present application.
【具体实施方式】【detailed description】
为使本领域的技术人员更好地理解本发明的技术方案,下面结合附图和具体实施方式对本申请所提供的一种辅助烹饪方法、家电设备及计算机存储介质做进一步详细描述。In order to enable those skilled in the art to better understand the technical solutions of the present invention, an auxiliary cooking method, home appliance, and computer storage medium provided by the present application will be described in further detail with reference to the accompanying drawings and specific implementations.
本申请辅助烹饪方法所实现的是在烹饪过程中,当即及时的对用户的烹饪过程进行指导,其所实现的效果类似于有烹饪专家在现场指导烹饪的情况,即实现了真正意义上的智能烹饪辅助。本申请强调及时性及针对性,不同于当前的预先演示烹饪过程的辅助方式,可以随时针对用户的烹饪情况来给出烹饪建议,辅助用户整个烹饪过程。特别适用于中式菜肴的烹饪过程,例如快炒的烹饪过程中,对于烹饪辅助的及时性要求很高,本申请能满足实时的提供烹饪建议。What the assisted cooking method of the present application realizes is to promptly guide the user's cooking process in the cooking process, and the effect achieved is similar to the situation in which a cooking expert guides cooking on the spot, that is, real intelligence is realized Cooking assistance. This application emphasizes timeliness and pertinence, and is different from the current auxiliary method of pre-demonstrating the cooking process, which can give cooking suggestions according to the user's cooking situation at any time to assist the user in the entire cooking process. It is particularly suitable for the cooking process of Chinese dishes, such as the quick-fry cooking process, which requires high timeliness of cooking assistance. This application can provide real-time cooking suggestions.
实现辅助烹饪的过程请参阅图1,图1是本申请辅助烹饪方法第一实施例的流程示意图,本实施例辅助烹饪方法包括以下步骤。Please refer to FIG. 1 for the process of implementing the auxiliary cooking. FIG. 1 is a schematic flowchart of the first embodiment of the auxiliary cooking method of the present application. The auxiliary cooking method of this embodiment includes the following steps.
S101:监测烹饪现场进而获取用户烹饪信息。S101: Monitor the cooking scene to obtain user cooking information.
本实施例所实现的是烹饪过程中针对性的烹饪辅助,因而首先对烹饪现场进行监测,即在用户进行烹饪时,对烹饪现场中的用户、菜品、炊具等进行监测,以获知烹饪情况,从而应对不同的烹饪情况给出不同的烹饪建议。What this embodiment implements is targeted cooking assistance in the cooking process, so the cooking site is first monitored, that is, when the user is cooking, the user, dishes, cookware, etc. in the cooking site are monitored to know the cooking situation, Therefore, different cooking suggestions should be given for different cooking situations.
本步骤S101中通过开启的监控设备来对烹饪现场进行监测,监控设备可以是输入装置麦克风、摄像头、传感器等,相应的,麦克风可监测烹饪现场的语 音,摄像头可监测烹饪现场的图像,传感器可为温度传感器、气味传感器可检测烹饪现场的菜品温度或气味。In this step S101, the cooking site is monitored by the opened monitoring device. The monitoring device may be an input device microphone, camera, sensor, etc. Correspondingly, the microphone can monitor the voice of the cooking site, the camera can monitor the image of the cooking site, the sensor can The temperature sensor and the odor sensor can detect the temperature or smell of the dishes on the cooking site.
本步骤S101在采用监控设备对烹饪现场进行监测,可进一步的获得用户烹饪信息,该用户烹饪信息表示在烹饪现场的用户语音,涉及到用户烹饪相关询问;烹饪图像,涉及到当前烹饪状态;菜品信息,涉及到当前菜品状态。根据这些用户烹饪信息,即可针对性的进行辅助烹饪。In this step S101, a monitoring device is used to monitor the cooking site, and the user's cooking information can be further obtained. The user's cooking information indicates the user's voice at the cooking site and relates to the user's cooking related inquiry; the cooking image relates to the current cooking state; Information related to the current dish status. According to these user cooking information, auxiliary cooking can be carried out in a targeted manner.
S102:匹配用户烹饪信息和预设的菜谱数据以生成烹饪建议。S102: Match user cooking information and preset recipe data to generate cooking suggestions.
在获取用户烹饪信息后,将用户烹饪信息与预设的菜谱数据进行匹配,从而生成针对用户烹饪信息的烹饪建议。本步骤S102的过程具体为:确定菜谱数据中与用户烹饪信息相关的数据标签,根据所确定的数据标签标识的数据来生成烹饪建议。After obtaining the user's cooking information, the user's cooking information is matched with the preset recipe data, thereby generating cooking suggestions for the user's cooking information. The process of this step S102 is specifically: determining a data tag related to the user's cooking information in the recipe data, and generating a cooking suggestion according to the data identified by the determined data tag.
本实施例中的菜谱数据为预先设置,在菜谱数据中包括有多个数据标签,以匹配到用户烹饪信息。进一步的,为了能够匹配到各类用户烹饪信息,在菜谱数据中还设置了多维度的数据标签,以支持各类用户烹饪信息的匹配及相关烹饪建议的生成。The recipe data in this embodiment is preset, and multiple data tags are included in the recipe data to match user cooking information. Further, in order to be able to match various types of user cooking information, multi-dimensional data labels are also set in the recipe data to support the matching of various types of user cooking information and the generation of related cooking suggestions.
具体来说,首先,菜谱数据中的数据标签可包括步骤标签、原料标签、动作标签、控制标签等。其中,步骤标签所标识的数据可以是烹饪步骤的具体内容,原料标签所标识的数据可以是具体原料的用量,动作标签标识的数据可以是烹饪动作的具体要求,控制标签所标识的数据可以是所控制的火候等。Specifically, first, the data labels in the recipe data may include step labels, raw material labels, action labels, control labels, and the like. Among them, the data identified by the step label can be the specific content of the cooking step, the data identified by the raw material label can be the amount of specific ingredients, the data identified by the action label can be the specific requirements of the cooking action, and the data identified by the control label can be The controlled fire is waiting.
以鱼香肉丝的菜谱为例说明,菜谱如下。Taking the recipe of fish-flavored pork shreds as an example, the recipe is as follows.
原料:猪肉300g,水发玉兰片100g,水发木耳100g,泡椒、姜、葱、蒜、酱油、香醋、绍酒、淀粉、盐、糖、肉汤适量;Raw materials: 300g pork, 100g water magnolia slices, 100g water fungus, pickled pepper, ginger, green onion, garlic, soy sauce, balsamic vinegar, wine, starch, salt, sugar, broth;
步骤:step:
第一步:猪肉、玉兰片、木耳切丝;The first step: pork, magnolia slices, shredded fungus;
第二步:切丝后的猪肉、玉兰片、木耳放入碗中,加盐、绍酒、湿淀粉拌匀;Step 2: Shred the pork, magnolia slices and fungus in a bowl, add salt, wine and wet starch and mix well;
第三步:泡椒剁细,与糖、香醋、酱油、淀粉、肉汤调成糖醋汁备用;The third step: finely chopped pickled pepper, mix with sugar, balsamic vinegar, soy sauce, starch, broth into sweet and sour sauce;
第四步:炒锅放置在旺火上,加热1分钟,油烧至六成热;The fourth step: Place the wok on the fire, heat it for 1 minute, the oil is burned to 60% heat;
第五步:加入拌匀的猪肉、玉兰片、木耳,翻炒1分钟;Step 5: Add the well-mixed pork, magnolia slices and wood ears, stir fry for 1 minute;
第六步:加入姜、葱、蒜爆炒出香味,翻炒;Step 6: Add ginger, spring onion, garlic and stir fry, stir fry;
第七步:加入糖醋汁,翻炒2分钟,颠翻几下。Step 7: Add sweet and sour sauce, stir-fry for 2 minutes, and turn it over a few times.
对应于上述菜谱,预设的菜谱数据中步骤标签可以是“第一步”等,相应的“第一步”所标识的数据为“猪肉、玉兰片、木耳切丝”;原料标签则可以是“猪肉”,其所标识的数据为“300g”;动作标签可以是“翻炒”,其所标识的数据为“1分钟”;控制标签可以是“火候”,其所标识的数据为“旺火”。Corresponding to the above recipes, the step label in the preset recipe data can be "first step", etc., the corresponding "first step" identifies the data as "pork, magnolia slices, shredded fungus"; the raw material label can be " "Pork", the marked data is "300g"; the action label can be "fried", the marked data is "1 minute"; the control label can be "Fire", and the marked data is "Wang Huo" ".
本实施例菜谱数据均被细化,并采用数据标签来标识;因而可比对数据标签及用户烹饪信息,从而确定相关的数据标签,即确定相关的数据;继而可根据该相关数据生成烹饪建议,以上述鱼香肉丝菜谱数据为例说明烹饪建议的生成。In this embodiment, the recipe data is refined and identified by data tags; therefore, the data tags and the user's cooking information can be compared to determine the relevant data tags, that is, the relevant data; and then cooking suggestions can be generated based on the relevant data. Take the above fish-flavored shredded meat recipe data as an example to illustrate the generation of cooking suggestions.
例如,用户烹饪信息为用户语音,而用户语音为“猪肉怎么切?”,此时则可找到对应的动作标签“切猪肉”以及该动作标签标识的数据“切丝”,继而可针对用户语音生成烹饪建议“切丝”。对于其他类型的用户烹饪信息,基于相同的过程来生成烹饪建议。For example, if the user's cooking information is the user's voice and the user's voice is "how to cut pork?", then the corresponding action label "cut pork" and the data "cutting" identified by the action label can be found, and then the user voice can be targeted. Generate cooking suggestions "shredded". For other types of user cooking information, cooking suggestions are generated based on the same process.
本实施例中预设的菜谱数据除了可以是上述文本菜谱数据,还可以是视频菜谱数据,对于属于同一菜谱的文本菜谱数据和视频菜谱数据,可使用同一数据标签,而数据标签在视频菜谱数据中所标识的则可以是视频段。The preset recipe data in this embodiment may be not only the above text recipe data but also video recipe data. For text recipe data and video recipe data belonging to the same recipe, the same data label may be used, and the data label is in the video recipe data The one identified in can be a video segment.
在本步骤中,生成的烹饪建议可以是基于文本菜谱数据,也可以是基于视频菜谱数据,例如对于上述用户烹饪信息为“猪肉怎么切?”的情况,所生成的烹饪建议可以是将猪肉切成丝的视频段。In this step, the generated cooking suggestion may be based on textual recipe data or video recipe data. For example, for the case where the above user cooking information is "how to cut pork?", the generated cooking suggestion may be cutting pork Silk video segment.
S103:呈现烹饪建议。S103: Present cooking suggestions.
在生成烹饪建议后,需将烹饪建议呈现给用户,以辅助用户进行烹饪。呈现的方式可以是语音播报烹饪建议或视频展示烹饪建议,其中,语音播报烹饪建议主要基于文本菜谱数据,而视频展示烹饪建议则主要基于视频菜谱数据。After the cooking suggestion is generated, the cooking suggestion needs to be presented to the user to assist the user in cooking. The presentation method may be voice broadcast cooking suggestions or video display cooking suggestions, wherein the voice broadcast cooking suggestions are mainly based on text recipe data, and the video display cooking suggestions are mainly based on video recipe data.
本实施例对烹饪现场进行监测,进而获取用户烹饪信息,可以实现实时的辅助烹饪,将用户烹饪信息与预设的菜谱数据进行匹配,从而生成烹饪建议,并呈现该烹饪建议以针对所监测到的用户烹饪信息辅助用户进行烹饪。In this embodiment, the cooking site is monitored, and then the user's cooking information is obtained, real-time auxiliary cooking can be realized, the user's cooking information is matched with the preset recipe data, thereby generating cooking suggestions, and presenting the cooking suggestions for the monitored The user's cooking information assists the user in cooking.
在实际烹饪过程中,可实现与用户的智能语音交互以辅助用户进行烹饪,例如在用户烹饪的过程中,可随时发出语音进行烹饪的相关询问,而对于本申请来说,在监测到用户语音后,则可针对用户语音进行应答,给出烹饪建议。In the actual cooking process, intelligent voice interaction with the user can be implemented to assist the user in cooking. For example, during the user's cooking process, voice-related inquiries can be issued at any time. For this application, the user's voice is monitored After that, you can respond to the user's voice and give cooking suggestions.
具体请参阅图2,图2是本申请辅助烹饪方法第二实施例的流程示意图,本实施例辅助烹饪方法包括以下步骤。Please refer to FIG. 2 for details. FIG. 2 is a schematic flowchart of a second embodiment of the auxiliary cooking method of the present application. The auxiliary cooking method of this embodiment includes the following steps.
S201:监测烹饪现场进而获取用户语音。S201: Monitor the cooking scene to obtain user voice.
本实施例基于图1所示实施例,即图1所示实施例内容可应用于本实施例,此外,本实施例针对烹饪现场的用户语音进行烹饪建议的应答,在本步骤S201中去监测烹饪现场的声音,进而获得用户语音。This embodiment is based on the embodiment shown in FIG. 1, that is, the content of the embodiment shown in FIG. 1 can be applied to this embodiment. In addition, this embodiment responds to cooking suggestions for the user voice of the cooking site, and monitors in this step S201 The sound of the cooking scene, and then obtain the user's voice.
由于在烹饪过程中无法避免会出现噪声问题,因而本步骤S201中可对获取的用户语音进行增强处理,该增强处理可采用硬件方式或软件方式,硬件方式例如通过阵列麦克风的拾音降噪以获取质量增强的用户语音,软件方式例如在通过一般麦克风获取到用户语音后,利用语音增强算法对用户语音进行处理,从而增强用户语音的质量。Since the noise problem cannot be avoided during the cooking process, in this step S201, the acquired user voice can be enhanced, which can be implemented in hardware or software. To obtain user voice with enhanced quality, for example, after obtaining the user voice through a general microphone, a software enhancement method is used to process the user voice, thereby enhancing the quality of the user voice.
S202:分析用户语音以获取烹饪意图。S202: Analyze user voice to obtain cooking intentions.
上述步骤S201监测烹饪现场所获取的用户语音为音频数据,还需对音频数据进行处理,对该用户语音进行语义理解,以获知该用户语音所表示的意图,在本实施例中即获取烹饪意图。In the above step S201, the user voice acquired by monitoring the cooking site is audio data, and the audio data needs to be processed to semantically understand the user voice to obtain the intention expressed by the user voice. In this embodiment, the cooking intention is obtained. .
具体来说,本实施例中基于自然语言理解技术来理解用户语音,以获取烹饪意图。首先对用户语音进行语音识别(Automatic Speech Recognition,ASR),得到语音文本信息,然后对语音文本信息进行语义理解(Natural Language Understanding,NLU),以获知烹饪意图。Specifically, in this embodiment, the user's voice is understood based on natural language understanding technology to obtain cooking intentions. First, perform speech recognition (Automatic Speech Recognition, ASR) on the user's speech to obtain speech text information, and then semantically understand the speech text information (Natural Language Understanding, NLU) to learn the cooking intention.
以图1所示实施例中的例子,若用户语音为“猪肉怎么切?”,首先通过ASR将其转化为文本“猪肉怎么切”,然后通过NLU获知烹饪意图为想知道猪肉该怎么切。Taking the example in the embodiment shown in FIG. 1, if the user's voice is "how to cut pork?", it is first converted into the text "how to cut pork" through ASR, and then the cooking intention is learned through NLU to want to know how to cut pork.
S203:匹配烹饪意图和菜谱数据以生成烹饪建议。S203: Match cooking intention and recipe data to generate cooking suggestions.
在分析用户语音获知烹饪意图后,即可将烹饪意图与菜谱数据进行匹配从而生成烹饪建议,该匹配过程与图1所示实施例中的类似,具体不再赘述。After the user's voice is analyzed and the cooking intention is known, the cooking intention can be matched with the recipe data to generate cooking suggestions. The matching process is similar to that in the embodiment shown in FIG. 1, and details are not repeated here.
S204:呈现烹饪建议。S204: Present cooking suggestions.
在生成烹饪建议后,即可呈现该烹饪建议,对于语音播报烹饪建议的方式还涉及到语言生成(Natural Language Generation,NLG)及语音播报(Text to Speech,TTS)的过程。即在理解烹饪意图生成烹饪建议后,还需基于烹饪建议生成模仿人类表达的语言文本,并将语言文本转化为语音进行播报,以回答用户语音。After the cooking suggestion is generated, the cooking suggestion can be presented. The manner of voice broadcast of the cooking suggestion also involves the process of language generation (Natural Language Generation, NLG) and voice broadcast (Text to Speech, TTS). That is, after understanding the cooking intentions and generating cooking suggestions, it is also necessary to generate language texts imitating human expressions based on the cooking suggestions, and convert the language texts into speech for broadcasting to answer the user's voice.
本实施例可及时应答用户烹饪过程中的语音询问,从而辅助用户进行烹饪。对于图2所示的实施例,适用于通过用户语音能够在菜谱数据中确定对应的具体数据从而生成烹饪建议的情况。而对于无法确定具体数据的情况,则采用图3 所示实施例来实现辅助烹饪,例如当用户询问“下一步做什么”,此时虽然能够识别到用户的烹饪意图为想知道下一烹饪步骤,但用户并未提供当前烹饪状态,即不确定当前处于哪个烹饪步骤,因而无法给出下一烹饪步骤的建议。This embodiment can promptly answer the user's voice query during cooking, thereby assisting the user in cooking. For the embodiment shown in FIG. 2, it is applicable to a case where the user voice can determine corresponding specific data in the recipe data to generate cooking suggestions. For cases where specific data cannot be determined, the embodiment shown in FIG. 3 is used to implement assisted cooking, for example, when the user asks “what to do next”, although the user’s cooking intention can be recognized as wanting to know the next cooking step , But the user has not provided the current cooking status, that is, it is not sure which cooking step is currently in, and therefore cannot give advice on the next cooking step.
图3是本申请辅助烹饪方法第三实施例的流程示意图,本实施例辅助烹饪方法包括以下步骤。FIG. 3 is a schematic flowchart of a third embodiment of the assisted cooking method of the present application. The assisted cooking method of this embodiment includes the following steps.
S301:监测烹饪现场进而获取用户语音。S301: Monitor the cooking scene to obtain user voice.
S302:分析用户语音以获取烹饪意图。S302: Analyze the user's voice to obtain cooking intentions.
本实施例基于图1和图2所示实施例,步骤S301-S302的具体内容与步骤S201-S202类似,具体不再赘述。This embodiment is based on the embodiments shown in FIG. 1 and FIG. 2, and the specific content of steps S301-S302 is similar to steps S201-S202, and the details are not repeated here.
S303:获取烹饪现场的烹饪图像。S303: Acquire cooking images at the cooking scene.
在获取到烹饪意图后,可先将该烹饪意图与菜谱数据进行匹配,若无法匹配,则主动获取烹饪现场的烹饪图像,以确定当前烹饪情况,从而结合当前烹饪情况,及时给出烹饪建议。本实施例中采用的方式是主动去获取烹饪现场的烹饪情况,而不是在无法匹配时,通过询问的方式来跟用户确认烹饪情况,相较于询问用户,本实施例所采用的方式更为人性化和智能化。After the cooking intention is acquired, the cooking intention can be matched with the recipe data first. If the matching is not possible, the cooking image of the cooking scene is actively acquired to determine the current cooking situation, so that the cooking recommendation can be given in time according to the current cooking situation. The method adopted in this embodiment is to actively obtain the cooking situation of the cooking site, rather than confirming the cooking situation with the user through querying when the match cannot be obtained. Compared with querying the user, the method adopted in this embodiment is more Humanization and intelligence.
S304:分析烹饪图像以获取烹饪状态。S304: Analyze the cooking image to obtain the cooking state.
本实施例中获取烹饪现场的烹饪情况采用的是获取烹饪图像的方式,通过对烹饪现场的图像识别来获知当前烹饪情况,即对烹饪图像进行分析,以获取烹饪状态。In this embodiment, the way to obtain the cooking situation of the cooking scene is to obtain the cooking image. The current cooking situation is obtained by recognizing the image of the cooking scene, that is, the cooking image is analyzed to obtain the cooking status.
上述步骤S303中可获取多个多方位的烹饪图像,本步骤S304中则对多个烹饪图像进行识别,即可尽量准确的获取到烹饪状态。In step S303, a plurality of multi-directional cooking images can be obtained. In step S304, the multiple cooking images are identified, so that the cooking state can be obtained as accurately as possible.
S305:匹配烹饪意图、烹饪状态和菜谱数据以生成烹饪建议。S305: Match cooking intention, cooking state and recipe data to generate cooking suggestions.
在获取当前烹饪状态后,则将烹饪意图、烹饪状态与菜谱数据进行匹配以生成烹饪建议,即根据烹饪意图和烹饪状态确定菜谱数据中的数据标签,即确定相关数据,根据所确定的相关数据即可生成烹饪建议。After obtaining the current cooking state, the cooking intention, the cooking state and the recipe data are matched to generate a cooking suggestion, that is, the data label in the recipe data is determined according to the cooking intention and the cooking state, that is, the relevant data is determined, and the determined relevant data is determined You can generate cooking suggestions.
以图1中的菜谱数据为例,本实施例步骤S301中所获取的用户语音为“下一步做什么?”,根据该用户语音无法确定步骤标签,因而还需获取执行步骤S303烹饪图像。Taking the recipe data in FIG. 1 as an example, the user voice acquired in step S301 of this embodiment is "What next?" According to the user voice, the step label cannot be determined, so the cooking image in step S303 needs to be acquired.
在步骤S304中对获取的烹饪图像进行识别以确定当前烹饪状态,例如若烹饪图像中显示用户正在将切丝后的猪肉、玉兰片、木耳进行拌匀,则可根据该烹饪图像确定当前烹饪状态处于第二步。In step S304, the obtained cooking image is identified to determine the current cooking state. For example, if the cooking image shows that the user is mixing shredded pork, magnolia slices, and auricularia, the current cooking state can be determined according to the cooking image The second step.
在步骤S305中基于当前烹饪状态和烹饪意图即可确定步骤标签,基于以上案例,所确定的步骤标签为“第三步”,继而可根据该步骤标签“第三步”所标识的数据“泡椒剁细,与糖、香醋、酱油、淀粉、肉汤调成糖醋汁备用”给出烹饪建议。In step S305, the step label can be determined based on the current cooking state and cooking intention. Based on the above case, the determined step label is "third step", and then the data "bubble" can be identified according to the step label "third step". Chop the finely chopped pepper, and mix it with sugar, balsamic vinegar, soy sauce, starch, and broth to make sweet and sour sauce."
S306:呈现烹饪建议。S306: Present cooking suggestions.
在给出烹饪建议后,呈现烹饪建议,基于以上案例,可播报语音“下一步将泡椒剁细,与糖、香醋、酱油、淀粉、肉汤调成糖醋汁备用”,也可直接播放该第三步的烹饪视频。After giving the cooking suggestions, present the cooking suggestions. Based on the above case, you can broadcast the voice "Chop the pickled peppers finely and mix them with sugar, balsamic vinegar, soy sauce, starch, and broth to make sweet and sour sauce", or you can directly Play the cooking video of this third step.
本实施例在用户语音无法明确给出烹饪建议的情况下,主动获取烹饪现场的烹饪图像,来根据当前的烹饪状态进一步确认用户的烹饪意图,继而给出明确的烹饪建议。本实施例可应对更多的用户语音询问,烹饪辅助更加智能,提高用户体验。In this embodiment, when the user's voice cannot clearly give cooking suggestions, the cooking image of the cooking scene is actively obtained to further confirm the user's cooking intentions according to the current cooking state, and then to give clear cooking suggestions. This embodiment can respond to more user voice queries, make cooking assistance more intelligent, and improve user experience.
本申请除了可针对用户语音问询来进行辅助烹饪,还可根据烹饪现场的情况,主动进行烹饪辅助。具体请参阅图4,图4是本申请辅助烹饪方法第四实施例的流程示意图,本实施例辅助烹饪方法包括以下步骤。In addition to assisting cooking by user's voice inquiry, this application can also actively perform cooking assistance according to the situation on the cooking site. Please refer to FIG. 4 for details. FIG. 4 is a schematic flowchart of a fourth embodiment of the auxiliary cooking method of the present application. The auxiliary cooking method of this embodiment includes the following steps.
S401:监测烹饪现场进而获取烹饪图像。S401: Monitor the cooking scene to obtain cooking images.
本实施例基于图1所示实施例,即图1所示实施例内容可应用于本实施例。在本实施例中监测烹饪现场的烹饪情况,并主动给出烹饪建议。在本步骤S401中,获取烹饪现场的烹饪图像,以获知烹饪情况。This embodiment is based on the embodiment shown in FIG. 1, that is, the content of the embodiment shown in FIG. 1 can be applied to this embodiment. In this embodiment, the cooking situation at the cooking site is monitored, and cooking suggestions are actively given. In this step S401, the cooking image of the cooking scene is acquired to know the cooking situation.
本步骤S401获取烹饪图像,一般采用摄像头进行拍摄,可周期性的拍摄多张图像,也可拍摄连续图像及进行视频拍摄。而对于烹饪现场,可能出现油烟很多的情况,因而摄像头可包括普通摄像头和红外摄像头,以辅助识别,使得识别更为准确;也可采用算法来对烹饪图像进行增强处理。In this step S401, a cooking image is obtained, and generally a camera is used for shooting, and multiple images can be periodically taken, or continuous images and video shooting can also be taken. For the cooking scene, there may be a lot of oil smoke, so the camera may include a normal camera and an infrared camera to assist recognition, so that the recognition is more accurate; algorithms can also be used to enhance the cooking image.
S402:分析烹饪图像以获取烹饪状态。S402: Analyze the cooking image to obtain the cooking state.
在获取到烹饪图像后分析该烹饪图像,从而获得烹饪状态,烹饪状态可包括当前烹饪状态和烹饪过程状态,当前烹饪状态可以包括菜品状态,当前烹饪步骤等;烹饪过程状态则可以包括与上一步骤间隔了多长时间,动作做了几次等。After acquiring the cooking image, analyze the cooking image to obtain the cooking state. The cooking state may include the current cooking state and the cooking process state. The current cooking state may include the dish state, the current cooking step, etc.; the cooking process state may include the previous one. How long is the interval between steps, how many actions did you wait.
在分析确定烹饪状态后,可当即给出烹饪建议,即直接进入到步骤S404。例如当确定烹饪状态获知当前烹饪步骤后,即可给出下一烹饪步骤的建议。After analyzing and determining the cooking state, the cooking suggestion can be given immediately, that is, directly go to step S404. For example, after determining the cooking status and learning the current cooking step, suggestions for the next cooking step can be given.
进一步的,也可先对烹饪状态进行判断,在用户烹饪异常的情况下才给出 烹饪建议,即先进行步骤S403。Further, the cooking state may be judged first, and the cooking suggestion is only given when the user is abnormal in cooking, that is, step S403 is performed first.
S403:判断烹饪状态是否符合基于菜谱数据预设的烹饪标准。S403: Determine whether the cooking state meets the cooking standard preset based on the recipe data.
本步骤通过烹饪标准来确定烹饪是否异常,而烹饪标准是基于菜谱数据预设的,例如图1所示实施例给出的菜谱数据例子中,基于菜谱数据,预设的烹饪标准可以是旺火、旺火加热1分钟、翻炒1分钟等。In this step, the cooking standard is used to determine whether the cooking is abnormal, and the cooking standard is preset based on the recipe data. For example, in the example of the recipe data given in the embodiment shown in FIG. 1, based on the recipe data, the preset cooking standard may be exuberant , Heat for 1 minute, stir fry for 1 minute, etc.
在判断出烹饪状态不符合烹饪标准的情况下,则执行步骤S404,即响应于烹饪状态不符合烹饪标准的判断结果,执行步骤S404。即执行步骤S404是在判断出烹饪状态为异常后执行。例如当根据烹饪图像获取到烹饪状态为中火,该烹饪状态即不符合烹饪标准,此时即需要执行步骤S404。在判断出烹饪状态符合烹饪标准的情况下,则无线给出烹饪建议,回到步骤S401,继续进行烹饪过程的监控。When it is determined that the cooking state does not meet the cooking standard, step S404 is executed, that is, in response to the judgment result that the cooking state does not meet the cooking standard, step S404 is executed. That is, step S404 is executed after it is determined that the cooking state is abnormal. For example, when it is acquired according to the cooking image that the cooking state is medium fire, the cooking state does not meet the cooking standard, and then step S404 needs to be performed. When it is judged that the cooking state meets the cooking standard, the cooking advice is given wirelessly, and the process returns to step S401 to continue monitoring the cooking process.
S404:匹配烹饪状态和菜谱数据以生成烹饪建议。S404: Match cooking status and recipe data to generate cooking suggestions.
步骤S402完成后直接进行步骤S404的情况,具体为匹配烹饪状态和菜谱数据,确定当前烹饪步骤,继而直接给出下一烹饪步骤的烹饪建议。After step S402 is completed, the situation of step S404 is directly performed, specifically to match the cooking status and recipe data, determine the current cooking step, and then directly give cooking suggestions for the next cooking step.
步骤S402完成后进行步骤S403的情况,在烹饪状态为异常的情况下,匹配烹饪状态和菜谱数据,给出正常烹饪状态的烹饪建议。After step S402 is completed, the situation of step S403 is performed. In the case where the cooking state is abnormal, the cooking state and recipe data are matched to give cooking suggestions in the normal cooking state.
S405:呈现烹饪建议S405: Present cooking suggestions
本实施例可通过对烹饪现场进行监测,在用户未进行询问时,也可监控用户的烹饪过程,以辅助用户依照食谱数据完成烹饪过程。进一步的,还可对烹饪过程中的异常情况进行监控,及时的给出烹饪建议,保证用户能够完成正确的烹饪过程。In this embodiment, by monitoring the cooking site, when the user does not inquire, the user's cooking process can also be monitored to assist the user in completing the cooking process according to the recipe data. Furthermore, abnormal conditions during the cooking process can be monitored, and cooking suggestions can be given in time to ensure that the user can complete the correct cooking process.
上述辅助烹饪的方法由智能家电设备实现,请参阅图5,图5是本申请家电设备一实施例的结构示意图,本实施例家电设备100包括输入装置11、处理器12、存储器13和输出装置14,本实施例家电设备100可实现上述辅助烹饪方法的实施例。其中,存储器13中存储有计算机程序,处理器12用于执行计算机程序以实现上述辅助烹饪方法。The above auxiliary cooking method is implemented by a smart home appliance. Please refer to FIG. 5. FIG. 5 is a schematic structural diagram of an embodiment of a home appliance in the present application. The home appliance 100 in this embodiment includes an input device 11, a processor 12, a memory 13, and an output device 14. In this embodiment, the home appliance 100 can implement the above-mentioned embodiment of the auxiliary cooking method. Among them, the memory 13 stores a computer program, and the processor 12 is used to execute the computer program to implement the above-mentioned auxiliary cooking method.
具体来说,输入装置11用于监测烹饪现场进而获取用户烹饪信息;处理器12用于匹配用户烹饪信息和预设于存储器13中的菜谱数据以生成烹饪建议;输出装置14则用于呈现烹饪建议。Specifically, the input device 11 is used to monitor the cooking scene and obtain user cooking information; the processor 12 is used to match the user cooking information and the recipe data preset in the memory 13 to generate cooking suggestions; the output device 14 is used to present cooking Suggest.
其中,处理器12可以是一种集成电路芯片,具有信号的处理能力。处理器92还可以是通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现 成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。Among them, the processor 12 may be an integrated circuit chip with signal processing capability. The processor 92 may also be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components . The general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
本实施例家电设备100可以是烹饪相关的家电,例如对于中国用户,由于饮食习惯,抽油烟机的使用较为普遍,因而用户在烹饪时,由家电设备抽油烟机来进行智能辅助烹饪。同理,对于欧美用户,则可将辅助烹饪功能设置在普遍使用的家电设备中,例如一体式厨房工作台等。In this embodiment, the home appliance 100 may be a cooking-related home appliance. For example, for Chinese users, due to dietary habits, the range hood is more commonly used. Therefore, when the user cooks, the home appliance hood performs intelligent assisted cooking. Similarly, for European and American users, the auxiliary cooking function can be set in commonly used household appliances, such as integrated kitchen workbenches.
以家电设备抽油烟机为例,其输入装置11可以是麦克风或摄像头,麦克风用于获取用户语音,摄像头用于获取烹饪图像;输出装置14则可以是显示屏或扬声器,显示屏用于实现视频展示烹饪建议,扬声器用于实现语音播报烹饪建议。Taking the range hood of household appliances as an example, the input device 11 may be a microphone or a camera, the microphone is used to obtain user voice, and the camera is used to obtain cooking images; the output device 14 may be a display screen or a speaker, and the display screen is used to realize video Displaying cooking suggestions, the speaker is used to realize voice broadcast of cooking suggestions.
由于抽油烟机在工作时存在噪音,因此还可采用阵列麦克风作为输入装置11来实现拾音降噪并提高信噪比以对用户语音进行增强处理。此外,由于抽油烟机在工作时存在油烟问题,可能会影响摄像头继而影响所获取的烹饪图像精度,对此可在摄像头上设置防油污保护罩。Because there are noises when the range hood is working, an array microphone can also be used as the input device 11 to implement sound pickup noise reduction and improve the signal-to-noise ratio to enhance the user's voice. In addition, due to the problem of oil smoke when the range hood is working, it may affect the camera and then the accuracy of the obtained cooking image. For this purpose, a greaseproof protective cover may be provided on the camera.
上述家电设备100中的处理器12和存储器13还可以服务器的形式存在,家电设备100中可包括通信装置,家电设备100通过通信装置连接到服务器,通过服务器来实现上述处理器12和存储器13的功能。对于该情况,在市场售卖时,所售卖的不仅仅是家电设备100,还包括家电设备100所连接的服务器的智能服务,因而物理结构上不包括处理器12和存储器13的家电设备100也应在本申请的保护范围内。The processor 12 and the memory 13 in the home appliance 100 may also exist in the form of a server. The home appliance 100 may include a communication device. The home appliance 100 is connected to the server through the communication device, and the server 12 and the memory 13 are implemented through the server. Features. In this case, when sold in the market, not only the home appliance 100 but also the intelligent service of the server to which the home appliance 100 is connected, so the home appliance 100 that does not physically include the processor 12 and the memory 13 should also be Within the scope of protection of this application.
对于图1-图4所示实施例的方法,其可以计算机程序的形式存在,因而本申请提出一种计算机存储介质,请参阅图6,图6是本申请计算机存储介质一实施例的结构示意图。本实施例计算机存储介质200中存储有计算机程序21,其可被执行以实现上述实施例中的方法。For the method of the embodiment shown in FIGS. 1-4, it may exist in the form of a computer program, so this application proposes a computer storage medium, please refer to FIG. 6, FIG. 6 is a schematic structural diagram of an embodiment of the computer storage medium of this application . In this embodiment, the computer storage medium 200 stores a computer program 21, which can be executed to implement the method in the above embodiment.
本实施例计算机存储介质200可以是U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等可以存储程序指令的介质,或者也可以为存储有该程序指令的服务器,该服务器可将存储的程序指令发送给其他设备运行,或者也可以自运行该存储的程序指令。In this embodiment, the computer storage medium 200 may be a medium that can store program instructions, such as a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk, or an optical disk. Or, it may be a server that stores the program instructions, and the server may send the stored program instructions to other devices to run, or it may run the stored program instructions by itself.
在本申请所提供的几个实施例中,应该理解到,所揭露的方法和装置,可 以通过其它的方式实现。例如,以上所描述的装置实施方式仅仅是示意性的,例如,模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed method and apparatus may be implemented in other ways. For example, the device implementation described above is only schematic. For example, the division of modules or units is only a division of logical functions. In actual implementation, there may be other divisions, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical, or other forms.
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施方式方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or software function unit.
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器(processor)执行本申请各个实施方式方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application may be essentially or part of the contribution to the existing technology or all or part of the technical solution may be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the methods of the embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code .
以上所述仅为本申请的实施方式,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only the embodiments of the present application, and do not limit the patent scope of the present application. Any changes to the equivalent structure or equivalent process made by the description and drawings of this application, or used directly or indirectly in other related technologies In the field, the same reason is included in the scope of patent protection of this application.

Claims (11)

  1. 一种辅助烹饪方法,其特征在于,所述方法包括:An auxiliary cooking method, characterized in that the method includes:
    监测烹饪现场进而获取用户烹饪信息;Monitor the cooking site to obtain user cooking information;
    匹配所述用户烹饪信息和预设的菜谱数据以生成烹饪建议;Matching the user's cooking information and preset recipe data to generate cooking suggestions;
    呈现所述烹饪建议。Present the cooking recommendations.
  2. 根据权利要求1所述的方法,其特征在于,所述监测烹饪现场进而获取用户烹饪信息,包括:The method according to claim 1, wherein the monitoring the cooking site to obtain user cooking information includes:
    监测烹饪现场进而获取用户语音;Monitor the cooking scene to obtain user voice;
    所述匹配所述用户烹饪信息和预设的菜谱数据以生成烹饪建议,包括:The matching of the user's cooking information and preset recipe data to generate cooking suggestions includes:
    分析所述用户语音以获取烹饪意图;Analyzing the user voice to obtain cooking intentions;
    匹配所述烹饪意图和所述菜谱数据以生成所述烹饪建议。The cooking intention and the recipe data are matched to generate the cooking suggestion.
  3. 根据权利要求2所述的方法,其特征在于,所述监测烹饪现场进而获取用户语音,之后包括:The method according to claim 2, wherein the monitoring the cooking site to obtain the user's voice, then includes:
    对所述用户语音进行增强处理;Enhance the user voice;
    所述分析所述用户语音以获取烹饪意图,包括:The analysis of the user's voice to obtain cooking intentions includes:
    分析增强处理后的所述用户语音以获取所述烹饪意图。The enhanced user voice is analyzed to obtain the cooking intention.
  4. 根据权利要求2所述的方法,其特征在于,所述分析所述用户语音以获取烹饪意图,之后包括:The method according to claim 2, wherein the analyzing the user's voice to obtain cooking intentions includes:
    获取所述烹饪现场的烹饪图像;Obtaining cooking images of the cooking scene;
    分析所述烹饪图像以获取烹饪状态;Analyzing the cooking image to obtain the cooking state;
    所述匹配所述用户烹饪信息和预设的菜谱数据以生成烹饪建议,包括:The matching of the user's cooking information and preset recipe data to generate cooking suggestions includes:
    匹配所述烹饪意图、烹饪状态和所述菜谱数据以生成所述烹饪建议。Matching the cooking intention, cooking state and the recipe data to generate the cooking suggestion.
  5. 根据权利要求1所述的方法,其特征在于,所述监测烹饪现场进而获取用户烹饪信息,包括:The method according to claim 1, wherein the monitoring the cooking site to obtain user cooking information includes:
    监测烹饪现场进而获取烹饪图像;Monitor the cooking scene to obtain cooking images;
    所述匹配所述用户烹饪信息和预设的菜谱数据以生成烹饪建议,包括:The matching of the user's cooking information and preset recipe data to generate cooking suggestions includes:
    分析所述烹饪图像以获取烹饪状态;Analyzing the cooking image to obtain the cooking state;
    匹配所述烹饪状态和所述菜谱数据以生成所述烹饪建议。The cooking status and the recipe data are matched to generate the cooking suggestion.
  6. 根据权利要求5所述的方法,其特征在于,所述分析所述烹饪图像以获取烹饪状态,之后包括:The method according to claim 5, wherein the analyzing the cooking image to obtain a cooking state includes:
    判断所述烹饪状态是否符合基于所述菜谱数据预设的烹饪标准;Judging whether the cooking state meets the cooking standard preset based on the recipe data;
    响应于所述烹饪状态不符合所述烹饪标准的判断结果,执行匹配所述烹饪状态和所述菜谱数据以生成所述烹饪建议的步骤。In response to the judgment result that the cooking state does not meet the cooking standard, a step of matching the cooking state and the recipe data to generate the cooking recommendation is performed.
  7. 根据权利要求1所述的方法,其特征在于,所述匹配所述用户烹饪信息和预设的菜谱数据以生成烹饪建议,包括:The method according to claim 1, wherein the matching of the user's cooking information and preset recipe data to generate cooking suggestions includes:
    确定所述菜谱数据中与所述用户烹饪信息相关的数据标签;Determining a data label related to the user's cooking information in the recipe data;
    根据所述数据标签所标识的数据生成所述烹饪建议。The cooking suggestion is generated according to the data identified by the data tag.
  8. 根据权利要求1所述的方法,其特征在于,所述呈现所述烹饪建议,包括:The method according to claim 1, wherein the presenting the cooking suggestion includes:
    语音播报所述烹饪建议或视频展示所述烹饪建议。Voice broadcast the cooking suggestion or video show the cooking suggestion.
  9. 一种家电设备,其特征在于,所述家电设备包括处理器和存储器,所述存储器中存储有计算机程序,所述处理器用于执行所述计算机程序以实现如权利要求1-8中任一项所述方法的步骤。A household electrical appliance, characterized in that the household electrical appliance includes a processor and a memory, a computer program is stored in the memory, and the processor is used to execute the computer program to implement any one of claims 1-8 The steps of the method.
  10. 根据权利要求9所述的家电设备,其特征在于,所述家电设备进一步包括输入装置和输出装置,所述处理器通过所述输入装置检测烹饪现场进而获取用户烹饪信息,所述处理器通过所述输出装置呈现所述烹饪建议;The household electrical appliance according to claim 9, characterized in that the household electrical appliance further includes an input device and an output device, the processor detects the cooking site through the input device to obtain user cooking information, and the processor passes the The output device presents the cooking suggestion;
    所述智能家电设备包括抽油烟机,所述输入装置包括麦克风或摄像头,所述输出装置包括显示屏或扬声器。The smart home appliance includes a cooker hood, the input device includes a microphone or a camera, and the output device includes a display screen or a speaker.
  11. 一种计算机存储介质,其特征在于,所述计算机存储介质存储有计算机程序,所述计算机程序被执行以实现如权利要求1-8中任一项所述方法的步骤。A computer storage medium, characterized in that the computer storage medium stores a computer program, and the computer program is executed to implement the steps of the method according to any one of claims 1-8.
PCT/CN2019/124116 2018-12-19 2019-12-09 Auxiliary cooking method, household appliance, and computer storage medium WO2020125475A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811557780.4 2018-12-19
CN201811557780.4A CN109683516B (en) 2018-12-19 2018-12-19 Auxiliary cooking method, household appliance and computer storage medium

Publications (1)

Publication Number Publication Date
WO2020125475A1 true WO2020125475A1 (en) 2020-06-25

Family

ID=66186905

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/124116 WO2020125475A1 (en) 2018-12-19 2019-12-09 Auxiliary cooking method, household appliance, and computer storage medium

Country Status (2)

Country Link
CN (1) CN109683516B (en)
WO (1) WO2020125475A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109683516B (en) * 2018-12-19 2020-10-16 广东美的白色家电技术创新中心有限公司 Auxiliary cooking method, household appliance and computer storage medium
CN112305951A (en) * 2019-07-30 2021-02-02 比亚迪股份有限公司 Cooking assisting method and device based on intelligent kitchen ware, terminal and storage medium
CN110609481A (en) * 2019-08-13 2019-12-24 深圳市享往科技有限公司 Cooking method, system and controller
CN110874961A (en) * 2019-11-29 2020-03-10 歌尔股份有限公司 Auxiliary teaching method and device applied to kitchen and wrist strap equipment
CN110989409A (en) * 2019-12-10 2020-04-10 珠海格力电器股份有限公司 Dish cooking method and device and storage medium
CN112287825A (en) * 2020-10-28 2021-01-29 维沃移动通信有限公司 Cooking assistance method and electronic device
CN112806860A (en) * 2020-12-31 2021-05-18 广东美的厨房电器制造有限公司 Cooking appliance control method and device, cooking appliance and storage medium
CN113662446A (en) * 2021-09-22 2021-11-19 深圳康佳电子科技有限公司 Internet of things-based cooking assistance method and device, intelligent terminal and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106020007A (en) * 2016-07-29 2016-10-12 广东美的厨房电器制造有限公司 Control method and cooking utensil
CN205881452U (en) * 2016-07-04 2017-01-11 佛山市顺德区美的电热电器制造有限公司 Electric appliance for cooking
CN107807554A (en) * 2017-08-29 2018-03-16 深圳市赛亿科技开发有限公司 A kind of intelligent kitchen cooks accessory system
CN107817702A (en) * 2017-10-24 2018-03-20 西安科锐盛创新科技有限公司 Intelligent cooking method and system
US20180101608A1 (en) * 2016-10-07 2018-04-12 Mixator AB Meal preparation orchestrator
CN108334606A (en) * 2018-02-01 2018-07-27 百度在线网络技术(北京)有限公司 Voice interactive method, device and server for smart home
CN109683516A (en) * 2018-12-19 2019-04-26 广东美的白色家电技术创新中心有限公司 Auxiliary cooking method, household appliance and computer storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102164126A (en) * 2011-03-17 2011-08-24 江苏省莱科信息技术有限公司 System for assisting in making food
CN103984725A (en) * 2014-05-15 2014-08-13 珠海优特电力科技股份有限公司 Method of retrieving product information of corresponding food material according to menu information
JP2016025031A (en) * 2014-07-23 2016-02-08 三菱電機株式会社 Induction heating cooker

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN205881452U (en) * 2016-07-04 2017-01-11 佛山市顺德区美的电热电器制造有限公司 Electric appliance for cooking
CN106020007A (en) * 2016-07-29 2016-10-12 广东美的厨房电器制造有限公司 Control method and cooking utensil
US20180101608A1 (en) * 2016-10-07 2018-04-12 Mixator AB Meal preparation orchestrator
CN107807554A (en) * 2017-08-29 2018-03-16 深圳市赛亿科技开发有限公司 A kind of intelligent kitchen cooks accessory system
CN107817702A (en) * 2017-10-24 2018-03-20 西安科锐盛创新科技有限公司 Intelligent cooking method and system
CN108334606A (en) * 2018-02-01 2018-07-27 百度在线网络技术(北京)有限公司 Voice interactive method, device and server for smart home
CN109683516A (en) * 2018-12-19 2019-04-26 广东美的白色家电技术创新中心有限公司 Auxiliary cooking method, household appliance and computer storage medium

Also Published As

Publication number Publication date
CN109683516A (en) 2019-04-26
CN109683516B (en) 2020-10-16

Similar Documents

Publication Publication Date Title
WO2020125475A1 (en) Auxiliary cooking method, household appliance, and computer storage medium
US8990274B1 (en) Generating a presentation associated with a set of instructions
US11257266B2 (en) Intelligent augmented reality (IAR) platform-based communication system via servers
US10224060B2 (en) Interactive home-appliance system, server device, interactive home appliance, method for allowing home-appliance system to interact, and nonvolatile computer-readable data recording medium encoded with program for allowing computer to implement the method
WO2020048222A1 (en) Sound effect adjustment method and apparatus, electronic device and storage medium
WO2017193540A1 (en) Method, device and system for playing overlay comment
US8323026B2 (en) Interactive recipe preparation using instructive device with integrated actuators to provide tactile feedback
CN110045638B (en) Cooking information recommendation method and device and storage medium
US20210249012A1 (en) Systems and methods for operating an output device
WO2020125457A1 (en) Multi-round interaction semantic understanding method and apparatus, and computer storage medium
US20130036353A1 (en) Method and Apparatus for Displaying Multimedia Information Synchronized with User Activity
WO2005088542A1 (en) System for recognizing cooking operation of foodstuff and program for recognizing cooking operation of foodstuff
CN110050303A (en) Speech-to-text conversion based on third-party agent content
CN106462646A (en) Control device, control method, and computer program
JP2011039860A (en) Conversation system, conversation method, and computer program using virtual space
US11900925B2 (en) Output method and electronic device
WO2020048217A1 (en) Sound effect adjustment method, apparatus, electronic device, and storage medium
CN110021299B (en) Voice interaction method, device, system and storage medium
WO2018031949A1 (en) An intelligent augmented reality (iar) platform-based communication system
JP2019200623A (en) Interactive processing method, interactive processing apparatus, and interactive processing program
CN107851094A (en) menu generating system
KR20230016013A (en) Inferring semantic label(s) for assistant device(s) based on device-specific signals
JP2019082982A (en) Cooking support device, cooking information generation device, cooking support system, cooking support method, and program
Saryazdi et al. Linguistic Redundancy and its Effects on Younger and Older Adults’ Real‐Time Comprehension and Memory
KR102463243B1 (en) Tinnitus counseling system based on user voice analysis

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19899751

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 03/11/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19899751

Country of ref document: EP

Kind code of ref document: A1