CN111513584B - Menu display method and device based on voice interaction and cooking equipment - Google Patents
Menu display method and device based on voice interaction and cooking equipment Download PDFInfo
- Publication number
- CN111513584B CN111513584B CN202010377582.0A CN202010377582A CN111513584B CN 111513584 B CN111513584 B CN 111513584B CN 202010377582 A CN202010377582 A CN 202010377582A CN 111513584 B CN111513584 B CN 111513584B
- Authority
- CN
- China
- Prior art keywords
- menu
- displayed
- display
- operation path
- cooking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J36/00—Parts, details or accessories of cooking-vessels
- A47J36/32—Time-controlled igniting mechanisms or alarm devices
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J27/00—Cooking-vessels
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J27/00—Cooking-vessels
- A47J27/04—Cooking-vessels for cooking food in steam; Devices for extracting fruit juice by means of steam ; Vacuum cooking vessels
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J36/00—Parts, details or accessories of cooking-vessels
- A47J36/32—Time-controlled igniting mechanisms or alarm devices
- A47J36/321—Time-controlled igniting mechanisms or alarm devices the electronic control being performed over a network, e.g. by means of a handheld device
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J37/00—Baking; Roasting; Grilling; Frying
- A47J37/06—Roasters; Grills; Sandwich grills
- A47J37/0623—Small-size cooking ovens, i.e. defining an at least partially closed cooking cavity
- A47J37/0629—Small-size cooking ovens, i.e. defining an at least partially closed cooking cavity with electric heating elements
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J27/00—Cooking-vessels
- A47J27/04—Cooking-vessels for cooking food in steam; Devices for extracting fruit juice by means of steam ; Vacuum cooking vessels
- A47J2027/043—Cooking-vessels for cooking food in steam; Devices for extracting fruit juice by means of steam ; Vacuum cooking vessels for cooking food in steam
Abstract
The application relates to a menu display method and device based on voice interaction and cooking equipment. The method comprises the following steps: and receiving a menu query instruction acquired by the cooking equipment, analyzing the menu query instruction, and acquiring a menu to be displayed. And when the menu to be displayed is matched and stored, acquiring the current display content of the display screen of the cooking equipment and the display operation path of the menu to be displayed. According to the current display content and the display operation path of the display screen, the shortest operation path for displaying the menu to be displayed is determined, the target animation guide corresponding to the shortest operation path is determined, and the target animation guide is played on the display screen of the cooking equipment. By adopting the method, the corresponding shortest operation path can be determined according to the voice query instruction, the user does not need to perform complicated operation in the process of using the cooking equipment to query the menu, the target animation associated with the menu query instruction is guided and demonstrated to the user for viewing, a simple operation flow for realizing the requirement is provided for the user, and the use convenience of the cooking equipment is improved.
Description
Technical Field
The application relates to the technical field of electric appliances, in particular to a menu display method and device based on voice interaction and cooking equipment.
Background
With the development of electrical appliance technology and the gradual popularization of artificial intelligence, the use of voice recognition technology in the aspect of smart home is more extensive, including the use on cooking equipment, so that the cooking equipment and the like gradually realize intellectualization and visualization.
Due to the gradual intellectualization of the cooking equipment, the product functions which can be realized by the cooking equipment are continuously enriched, and richer choices can be provided for users in the using process. Due to the diversity of functions of the cooking device, the user has difficulty in selecting the cooking device accordingly during use. Meanwhile, because the operation interface corresponding to the diversified functions is also very complex, the user needs to perform more complicated operations or perform a large number of attempts to acquire the desired menu information in the use process of the cooking equipment, so that the use convenience for the cooking equipment is low.
Disclosure of Invention
Therefore, in order to solve the technical problems, a menu display method and device based on voice interaction and cooking equipment capable of improving the use convenience of the cooking equipment are provided.
A menu display method based on voice interaction, the method comprising:
receiving a menu query instruction collected by cooking equipment;
analyzing the menu query instruction to obtain a menu to be displayed;
when the menu to be displayed is matched and stored, acquiring the current display content of a display screen of the cooking equipment and the display operation path of the menu to be displayed;
determining the shortest operation path for displaying the menu to be displayed according to the current display content of the display screen and the display operation path;
and determining a target animation guide corresponding to the shortest operation path, and playing the target animation guide on a display screen of the cooking equipment.
In one embodiment, determining the manner of the target animation guidance corresponding to the shortest operation path includes:
determining an operation node corresponding to the shortest operation path according to the display content of the display screen;
acquiring a path identifier between the operation node and the next operation node according to the operation node;
searching corresponding pre-stored animation guide according to the path identifier to obtain a target animation guide corresponding to the shortest operation path; the pre-stored animation guide is used for guiding a user to operate on one operation node and switch to the next operation node.
In one embodiment, the determining, according to the current display content of the display screen and the display operation path, the shortest operation path for displaying the menu to be displayed includes:
determining a return operation path of the menu to be displayed according to the current display content of the display screen and the menu to be displayed;
and generating the shortest operation path of the menu to be displayed according to the return operation path and the display operation path.
In one embodiment, the determining, according to the current display content of the display screen and the menu to be displayed, a manner of a return operation path of the menu to be displayed includes:
acquiring a current display menu corresponding to the current display content of the display screen, and determining a first cooking mode of the current display menu;
comparing the first cooking mode with a second cooking mode of the menu to be displayed;
and when the first cooking mode is determined to be inconsistent with the second cooking mode, determining an operation path of the main interface returned to the display screen as a return operation path of the menu to be displayed.
In one embodiment, the method further comprises:
when the first cooking mode is determined to be consistent with the second cooking mode, acquiring a common superior operation node for displaying the current display menu and the menu to be displayed;
and determining the operation path returned to the common superior operation node as the return operation path of the menu to be displayed.
In one embodiment, the manner of obtaining the display operation path of the menu to be displayed includes:
acquiring each operation node corresponding to the display control operation of the menu to be displayed;
acquiring a standard tree structure corresponding to the display control operation of the cooking equipment;
and based on the standard tree structure, connecting the operation nodes to obtain a display operation path of the menu to be displayed.
A menu display apparatus based on voice interaction, the apparatus comprising:
the menu query instruction receiving module is used for receiving a menu query instruction collected by the cooking equipment;
the menu to be displayed acquisition module is used for analyzing the menu query instruction and acquiring a menu to be displayed;
the menu to be displayed matching module is used for acquiring the current display content of a display screen of the cooking equipment and the display operation path of the menu to be displayed when the menu to be displayed is matched and stored;
the shortest operation path determining module is used for determining the shortest operation path for displaying the menu to be displayed according to the current display content of the display screen and the display operation path;
and the target animation guide playing module is used for determining the target animation guide corresponding to the shortest operation path and playing the target animation guide on a display screen of the cooking equipment.
In one embodiment, the apparatus further comprises a target animation direction generation module for:
determining an operation node corresponding to the shortest operation path according to the display content of the display screen;
acquiring a path identifier between the operation node and the next operation node according to the operation node;
searching corresponding pre-stored animation guide according to the path identifier to obtain a target animation guide corresponding to the shortest operation path; the pre-stored animation guide is used for guiding a user to operate on one operation node and switch to the next operation node.
A cooking apparatus includes a cooking apparatus main body, a display apparatus, a sound collection apparatus, a memory, and a processor, the display apparatus, the sound collection apparatus, the memory, and the processor being provided on the cooking apparatus main body; the display equipment and the sound acquisition equipment are connected with the memory and the processor; the memory stores a computer program which when executed by the processor performs the steps of:
receiving a menu query instruction collected by cooking equipment;
analyzing the menu query instruction to obtain a menu to be displayed;
when the menu to be displayed is matched and stored, acquiring the current display content of a display screen of the cooking equipment and the display operation path of the menu to be displayed;
determining the shortest operation path for displaying the menu to be displayed according to the current display content of the display screen and the display operation path;
and determining a target animation guide corresponding to the shortest operation path, and playing the target animation guide on a display screen of the cooking equipment.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
receiving a menu query instruction collected by cooking equipment;
analyzing the menu query instruction to obtain a menu to be displayed;
when the menu to be displayed is matched and stored, acquiring the current display content of a display screen of the cooking equipment and the display operation path of the menu to be displayed;
determining the shortest operation path for displaying the menu to be displayed according to the current display content of the display screen and the display operation path;
and determining a target animation guide corresponding to the shortest operation path, and playing the target animation guide on a display screen of the cooking equipment.
According to the menu display method and device based on voice interaction and the cooking equipment, the menu query instruction collected by the cooking equipment is received and analyzed, the menu to be displayed is obtained, and when the menu to be displayed is matched and stored, the current display content of the display screen of the cooking equipment and the display operation path of the menu to be displayed are obtained. And determining the shortest operation path for displaying the menu to be displayed according to the current display content and the display operation path of the display screen, further determining a target animation guide corresponding to the shortest operation path, and playing the target animation guide on the display screen of the cooking equipment. Because the corresponding shortest operation path can be determined according to the voice query instruction sent by the user, the user does not need to perform fussy selection or return operation in the process of using the cooking equipment to query the menu, the target animation associated with the menu query instruction can be guided and demonstrated to the user for viewing, a simple operation flow for realizing the self requirement is provided for the user, and the use convenience of the cooking equipment is improved.
Drawings
FIG. 1 is a diagram of an application environment of a menu display method based on voice interaction in one embodiment;
FIG. 2 is a flowchart illustrating a menu display method based on voice interaction according to an embodiment;
FIG. 3 is a diagram illustrating a standard tree structure of a display control operation performed by the cooking apparatus according to an embodiment;
FIG. 4 is a schematic diagram of a target animation guidance play interface based on a display screen of a cooking device in one implementation;
FIG. 5 is a flowchart illustrating the determination of a return operation path for a menu to be displayed in one embodiment;
FIG. 6 is a block diagram showing the structure of a menu display device based on voice interaction in one embodiment;
fig. 7 is an internal structure view of a cooking apparatus in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The menu display method based on voice interaction provided by the application can be applied to the application environment shown in fig. 1. Wherein the cooking appliance 102 communicates with the server 104 over a network. The user sends voice information for the cooking device 102, the cooking device 102 receives the voice information, collects a menu query instruction, and guides a target animation corresponding to the menu query instruction to be played on a display screen of the cooking device 102. The cooking device 102 obtains the menu to be displayed corresponding to the menu query instruction by analyzing the menu query instruction, and obtains the current display content of the display screen of the cooking device and the display operation path of the menu to be displayed when the menu to be displayed is matched with the menu to be displayed stored locally in the cooking device 102. The cooking device 102 determines the shortest operation path for displaying the menu to be displayed according to the current display content and the display operation path of the display screen, determines the target animation guide corresponding to the shortest operation path, and plays the target animation guide on the display screen of the cooking device 102.
The operation of matching whether the menu to be displayed is stored or not can also be realized by the server 104. Specifically, the cooking device 102 obtains the menu to be displayed corresponding to the menu query instruction by analyzing the menu query instruction, and sends the menu to be displayed to the server 104, so that the server 104 determines whether the corresponding menu to be displayed can be successfully matched in the cloud storage.
The cooking device 102 includes but is not limited to an oven, a steam box, a steaming and baking all-in-one machine, a steaming and micro-combining machine, an automatic cooker and other intelligent cooking devices, and the server 104 may be implemented by an independent server or a server cluster formed by a plurality of servers.
In one embodiment, as shown in fig. 2, a menu display method based on voice interaction is provided, which is described by taking the method as an example applied to the cooking apparatus in fig. 1, and comprises the following steps:
and step S202, receiving a menu inquiry instruction collected by the cooking equipment.
Specifically, a user sends voice information aiming at the cooking equipment, and the cooking equipment receives the voice information, analyzes the voice information and collects a menu query instruction carried by the voice information. The menu query instruction comprises a menu to be displayed corresponding to user requirements, and the cooking equipment can be intelligent cooking equipment such as an oven, a steam box, a steaming and baking all-in-one machine, a steaming and micro-combining machine and an automatic cooking machine. For example, the voice information sent by the user is "a method for making fruit cakes", the cooking device analyzes the voice information "the method for making fruit cakes", and determines that the menu query instruction carried by the voice information is "search for fruit cakes from a menu", and then the menu query instruction collected by the cooking device is "search for fruit cakes from a menu".
And step S204, analyzing the menu query instruction to acquire the menu to be displayed.
Specifically, the menu to be displayed corresponding to the user requirement is determined by analyzing the collected menu query instruction. For example, when it is determined that a menu query instruction carried by voice information is "search for fruit cake from menu", the menu query instruction is analyzed to obtain that a menu to be displayed corresponding to the menu query instruction is "fruit cake", which indicates how to use cooking equipment according to the user's requirement, so that the menu displayed as "fruit cake" on the display screen, and a corresponding manufacturing method. The making method comprises the steps of making materials required for 'fruit cake', cooking modes, cooking time and a specific cooking process.
And step S206, when the menu to be displayed is matched and stored, acquiring the current display content of the display screen of the cooking equipment and the display operation path of the menu to be displayed.
Specifically, when the menu to be displayed is matched and stored, the current display content of the display screen of the cooking equipment is obtained, and whether the currently displayed menu interface or the currently displayed main interface is determined according to the current display content of the display screen. When the display screen is determined to be currently displayed on the main interface, the display operation path of the menu to be displayed is obtained, and the display operation path of the menu to be displayed is determined as the shortest operation path of the menu to be displayed.
The manner of matching whether the menu to be displayed is stored may be implemented by the cooking apparatus or the server. The cooking equipment can be matched from local storage of the cooking equipment, and when the menu to be displayed is matched with the local storage, the current display content of a display screen of the cooking equipment and the display operation path of the menu to be displayed are obtained. Similarly, the cooking device sends the menu to be displayed to the server, so that the server determines whether the corresponding menu to be displayed can be successfully matched in the cloud storage.
And S208, determining the shortest operation path for displaying the menu to be displayed according to the current display content and the display operation path of the display screen.
Specifically, a return operation path of the menu to be displayed is determined according to the current display content of the display screen and the menu to be displayed, and the shortest operation path of the menu to be displayed is generated according to the return operation path and the display operation path.
When the currently displayed menu interface is determined according to the currently displayed content of the display screen, whether the currently displayed menu is consistent with the menu to be displayed or not is judged, if the currently displayed menu is consistent with the menu to be displayed, other operations are not needed, the specific manufacturing method of the currently displayed menu is used for being checked by a user, and therefore the display operation path of the menu to be displayed is determined to be the shortest operation path of the menu to be displayed.
Further, when the current display menu is inconsistent with the menu to be displayed, whether the current display menu and the menu to be displayed are in the same cooking mode or not is determined by acquiring the cooking mode of the current display menu and the cooking mode of the menu to be displayed. If the cooking modes of the current display menu and the menu to be displayed are consistent, only the display interfaces of various menus are required to be returned to the same cooking mode to select, and the operation path of the display interfaces of various menus returned to the same cooking mode is determined as the return operation path of the menu to be displayed. And when the cooking modes of the current display menu and the menu to be displayed are not consistent, returning to the main interface of the display screen of the cooking equipment, and determining the operation path returning to the main interface as the returning operation path of the menu to be displayed.
In one embodiment, the manner of obtaining the display operation path of the menu to be displayed includes:
and acquiring each operation node corresponding to the display control operation of the menu to be displayed, and a standard tree structure corresponding to the display control operation of the cooking equipment, and connecting each operation node based on the standard tree structure to obtain a display operation path of the menu to be displayed.
Wherein the display control operation performed by the cooking apparatus sets a corresponding standard tree structure. When a user starts to use the cooking device, as shown in fig. 3, fig. 3 provides a standard tree structure schematic diagram of a display control operation performed by the cooking device, referring to fig. 3, taking a main interface of a display screen of the cooking device as an example, first, a menu interface includes different cooking modes, such as a steaming mode, a steaming and baking mode, and corresponding menu categories, including a baking menu, a steaming menu, and a steaming and baking menu, are set in the different cooking modes. The dish categories to which different menus belong are set under different menu categories, including vegetables, meat, aquatic products, cake desserts and the like. Specific menus are set under different dish categories, and the menus comprise corresponding manufacturing methods, including required ingredients, cooking time, detailed cooking processes and the like. For example, in the baking menu, different menus such as "cookies", "cheese cakes" and the like are set for cake desserts, baked mutton chops "," baked chicken wings "and the like are set for meat, baked eggplants", "baked corns" and the like are set for vegetables, and different menus such as "baked crucian", "baked inkfish" and the like are set for aquatic products.
And further taking the cooking mode, the menu type, the dish type of the menu and the corresponding specific menu of the display interface as operation nodes for displaying control operation, thereby forming a standard tree structure for displaying control operation performed by the cooking equipment.
Further, by obtaining each operation node corresponding to the display control operation of the menu to be displayed, and based on a corresponding preset standard tree structure when the cooking device performs the display control operation, determining the position of each operation node of the display control operation of the menu to be displayed in the standard tree structure, and by sequentially connecting each operation node, obtaining the display operation path of the menu to be displayed.
And step S210, determining a target animation guide corresponding to the shortest operation path, and playing the target animation guide on a display screen of the cooking equipment.
Specifically, the operation node corresponding to the shortest operation path is determined according to the display content of the display screen, and a path identifier between the operation node and the next operation node is obtained according to the operation node. And then searching corresponding pre-stored animation guide according to the path identifier to obtain a target animation guide corresponding to the shortest operation path, and playing the target animation guide on a display screen of the cooking equipment. The pre-stored animation guide is used for guiding a user to operate on one operation node and switch to the next operation node.
According to the display content of the display screen and the menu to be displayed, the return operation path of the menu to be displayed can be determined, and then each operation node corresponding to the return operation path is obtained. The operation node corresponding to the shortest operation path of the menu to be displayed can be determined by obtaining each operation node corresponding to the display control operation of the menu to be displayed and according to each operation node corresponding to the return operation path and each operation node corresponding to the display control operation.
Further, by obtaining each operation node corresponding to the determined shortest operation path, extracting a path identifier between each operation node and the next operation node, and searching for a corresponding pre-stored animation guide according to the path identifier. The pre-stored animation guide can be stored in the local cooking equipment or in the cloud storage corresponding to the server. And combining a plurality of pre-stored animation guides searched by the path identifier between every two operation nodes to generate a target animation guide corresponding to the shortest operation path, and playing the target animation guide on a display screen of the cooking equipment for a user to check, and guiding the user to use the cooking equipment to obtain a required menu.
In one embodiment, the menu query instruction collected by the cooking device is "search for cookies from the menu", and the menu to be displayed obtained by analyzing the menu query instruction is "cookies". As shown in fig. 4, fig. 4 provides a target animation guidance playing interface based on a display screen of a cooking device, and referring to fig. 4, when a menu to be displayed obtained by parsing a menu query instruction is a "cookie", the corresponding target animation guidance includes: when the current interface is determined to be the menu display interface according to the current display content of the display screen of the cooking equipment, and the current display menu is the 'chicken steaming block', the cooking mode of the current display menu is a steaming mode, and the cooking mode of the menu to be displayed is a baking mode, so that the current menu and the menu to be displayed belong to different cooking modes and need to return to the main interface of the display screen of the cooking equipment. After returning to the main interface, guiding a user to start from the main interface according to a display operation path of the cookies, firstly selecting the cooking mode as a baking mode, selecting a baking menu in the baking mode, selecting cake desserts corresponding to the cookies from different dish categories in the baking menu, selecting the menus of the cookies from the cake desserts, and displaying required ingredients, cooking time and a specific cooking process corresponding to the cookies on a display screen of the cooking equipment when the fact that the user selects the menus of the cookies is detected.
According to the menu display method based on voice interaction, a menu query instruction collected by cooking equipment is received and analyzed, a menu to be displayed is obtained, and when the menu to be displayed is matched and stored, the current display content of a display screen of the cooking equipment and the display operation path of the menu to be displayed are obtained. And determining the shortest operation path for displaying the menu to be displayed according to the current display content and the display operation path of the display screen, further determining a target animation guide corresponding to the shortest operation path, and playing the target animation guide on the display screen of the cooking equipment. Because the corresponding shortest operation path can be determined according to the voice query instruction sent by the user, the user does not need to perform fussy selection or return operation in the process of using the cooking equipment to query the menu, the target animation associated with the menu query instruction can be guided and demonstrated to the user for viewing, a simple operation flow for realizing the self requirement is provided for the user, and the use convenience of the cooking equipment is improved.
In one embodiment, as shown in fig. 5, the step of determining a return operation path of the menu to be displayed, that is, the step of determining a return operation path of the menu to be displayed according to the current display content of the display screen and the menu to be displayed, includes:
step S502, acquiring a current display menu corresponding to the current display content of the display screen, and determining a first cooking mode of the current display menu.
Specifically, the current display content of a display screen of the cooking equipment is obtained, and when the menu interface displayed currently is determined according to the current display content, the current display menu is obtained, and whether the current display menu is consistent with the menu to be displayed or not is judged. And when the current display menu is inconsistent with the menu to be displayed, acquiring a first cooking mode of the current display menu.
Step S504, the first cooking mode is compared with a second cooking mode of the menu to be displayed.
Specifically, a second cooking mode of the menu to be displayed is obtained, and the first cooking mode of the menu currently displayed and the second cooking mode of the menu to be displayed are compared. Wherein the cooking modes include a steaming mode, and a baking mode, and accordingly, the first cooking mode and the second cooking mode may be identical or non-identical.
Step S506, when the first cooking mode is determined to be inconsistent with the second cooking mode, determining the operation path of the main interface of the return display screen as the return operation path of the menu to be displayed.
Specifically, when the first cooking mode is determined to be inconsistent with the second cooking mode according to the comparison result of the first cooking mode and the second cooking mode, the operation path of the main interface of the return display screen is determined as the return operation path of the menu to be displayed. For example, when the currently displayed menu is a "chicken steaming block", the cooking mode of the currently displayed menu is a steaming mode, and when the to-be-displayed menu is a "chicken leg roasting", the cooking mode of the to-be-displayed menu is a steaming mode, and the first cooking mode of the currently displayed menu and the second cooking mode of the to-be-displayed menu are not consistent, the main interface of the display screen needs to be returned, and the cooking mode needs to be reselected.
Step S508, when it is determined that the first cooking mode is consistent with the second cooking mode, a common upper operation node of the current display menu and the menu to be displayed is obtained.
Specifically, when the first cooking mode is determined to be consistent with the second cooking mode according to the comparison result of the first cooking mode and the second cooking mode, for example, when the currently displayed menu is a 'chicken steaming block', the cooking mode of the currently displayed menu is a steaming mode, and when the to-be-displayed menu is a 'corn steaming mode', the cooking mode of the to-be-displayed menu is also a steaming mode, and a common superior operation node of the currently displayed menu and the to-be-displayed menu is obtained. In this embodiment, the common upper operation node of the current display menu "steamed chicken nuggets" and the menu to be displayed "steamed corn" is a steaming menu in a steaming mode, and when the current display menu and the menu to be displayed are in the same cooking mode, the user does not need to be guided to return to the main interface, thereby reducing the operation steps in the menu query process.
Step S510, determining an operation path returning to the common upper operation node as a return operation path of the menu to be displayed.
Specifically, when the first cooking mode is consistent with the second cooking mode, the user does not need to be guided to return to the main interface, and only the common upper operation node of the currently displayed menu and the menu to be displayed needs to be returned, and the operation path of the common upper operation node is determined as the return operation path of the menu to be displayed. For example, if the current display menu is a 'chicken steaming block', and the menu to be displayed is 'corn steaming', a common superior operation node of the current display menu 'chicken steaming block' and the menu to be displayed 'corn steaming' is determined as a steaming menu in a steaming mode, and an operation path returning to the steaming menu is determined as a return path of the menu to be displayed 'corn steaming'.
In this embodiment, different return operation paths are provided based on the first cooking mode of the currently displayed menu and the second cooking mode of the menu to be displayed. And when the first cooking mode is determined to be inconsistent with the second cooking mode, determining the operation path of the main interface of the return display screen as the return operation path of the menu to be displayed. And when the first cooking mode is determined to be consistent with the second cooking mode, acquiring a common superior operation node of the current display menu and the menu to be displayed, and determining an operation path returning to the common superior operation node as a returning operation path of the menu to be displayed. The corresponding return operation path is obtained through analysis under different conditions, so that the operation steps of a user for obtaining a required menu can be reduced, the operation complexity of the cooking equipment is reduced, and the use convenience of the cooking equipment is further improved.
It should be understood that although the steps in the flowcharts of fig. 2 and 5 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2 and 5 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least some of the other steps.
In one embodiment, as shown in fig. 6, there is provided a voice interactive menu display apparatus including: a menu query instruction receiving module 602, a to-be-displayed menu obtaining module 604, a to-be-displayed menu matching module 606, a shortest operation path determining module 608, and a target animation guidance playing module 610, wherein:
and a menu query instruction receiving module 602, configured to receive a menu query instruction collected by the cooking device.
And a to-be-displayed menu obtaining module 604, configured to analyze the menu query instruction to obtain a to-be-displayed menu.
And a to-be-displayed menu matching module 606, configured to acquire current display content of a display screen of the cooking apparatus and a display operation path of the to-be-displayed menu when the to-be-displayed menu is matched and stored.
The shortest operation path determining module 608 is configured to determine, according to the current display content and the display operation path of the display screen, a shortest operation path for displaying the menu to be displayed.
And a target animation guide playing module 610, configured to determine a target animation guide corresponding to the shortest operation path, and play the target animation guide on a display screen of the cooking apparatus.
In the menu display device based on voice interaction, a menu query instruction collected by cooking equipment is received and analyzed, a menu to be displayed is obtained, and when the menu to be displayed is matched and stored, the current display content of a display screen of the cooking equipment and the display operation path of the menu to be displayed are obtained. And determining the shortest operation path for displaying the menu to be displayed according to the current display content and the display operation path of the display screen, further determining a target animation guide corresponding to the shortest operation path, and playing the target animation guide on the display screen of the cooking equipment. Because the corresponding shortest operation path can be determined according to the voice query instruction sent by the user, the user does not need to perform fussy selection or return operation in the process of using the cooking equipment to query the menu, the target animation associated with the menu query instruction can be guided and demonstrated to the user for viewing, a simple operation flow for realizing the self requirement is provided for the user, and the use convenience of the cooking equipment is improved.
In one embodiment, the shortest operation path determining module is further configured to:
acquiring a current display menu corresponding to current display content of a display screen, and determining a first cooking mode of the current display menu; comparing the first cooking mode with a second cooking mode of a menu to be displayed;
when the first cooking mode is determined to be inconsistent with the second cooking mode, determining an operation path of a main interface of a return display screen as a return operation path of a menu to be displayed;
when the first cooking mode is determined to be consistent with the second cooking mode, acquiring a common superior operation node of a current display menu and a menu to be displayed; and determining the operation path returning to the common upper operation node as the returning operation path of the menu to be displayed.
In the shortest operation path determining module, different return operation paths are provided based on a first cooking mode of a currently displayed menu and a second cooking mode of a menu to be displayed. And when the first cooking mode is determined to be inconsistent with the second cooking mode, determining the operation path of the main interface of the return display screen as the return operation path of the menu to be displayed. And when the first cooking mode is determined to be consistent with the second cooking mode, acquiring a common superior operation node of the current display menu and the menu to be displayed, and determining an operation path returning to the common superior operation node as a returning operation path of the menu to be displayed. The corresponding return operation path is obtained through analysis under different conditions, so that the operation steps of a user for obtaining a required menu can be reduced, the operation complexity of the cooking equipment is reduced, and the use convenience of the cooking equipment is further improved.
In one embodiment, a menu display apparatus based on voice interaction is provided, the apparatus further comprising a target animation guide generation module for:
determining an operation node corresponding to the shortest operation path according to the display content of the display screen; acquiring a path identifier between the operation node and the next operation node according to the operation node; searching corresponding pre-stored animation guide according to the path identifier to obtain a target animation guide corresponding to the shortest operation path; the pre-stored animation guide is used for guiding a user to operate on one operation node and switch to the next operation node.
In the target animation guidance generation module, the operation node corresponding to the shortest operation path is determined according to the display content of the display screen, and the path identifier between the operation node and the next operation node is obtained according to the operation node, so that the corresponding pre-stored animation guidance is searched according to the path identifier, and the target animation guidance corresponding to the shortest operation path is obtained. The combination that the prestored animation that corresponds through the route sign to between with the operation node guides is realized, the target animation that the quick definite corresponds with shortest operation route guides, guides through broadcast target animation on the display screen, can provide the simple and convenient use flow who uses to cooking equipment for the user, improves the convenience of using cooking equipment.
For specific limitations of the menu display device based on voice interaction, reference may be made to the above limitations of the menu display method based on voice interaction, which are not described herein again. The respective modules in the above-described menu display apparatus based on voice interaction may be wholly or partially implemented by software, hardware, and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a cooking device, the internal structure of which may be as shown in fig. 7. The computer equipment comprises a processor, a memory, a communication interface, a display screen, a sound acquisition device and an input device which are connected through a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a menu display method based on voice interaction. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 7 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, there is provided a cooking apparatus including a cooking apparatus main body, a display apparatus, a sound collection apparatus, a memory, and a processor, the display apparatus, the sound collection apparatus, the memory, and the processor being provided on the cooking apparatus main body; the display equipment and the sound acquisition equipment are connected with the memory and the processor; the memory has stored therein a computer program which when executed by the processor performs the steps of:
receiving a menu query instruction collected by cooking equipment;
analyzing a menu query instruction to obtain a menu to be displayed;
when the menu to be displayed is matched and stored, acquiring the current display content of a display screen of the cooking equipment and the display operation path of the menu to be displayed;
determining the shortest operation path for displaying the menu to be displayed according to the current display content and the display operation path of the display screen;
and determining a target animation guide corresponding to the shortest operation path, and playing the target animation guide on a display screen of the cooking equipment.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
determining an operation node corresponding to the shortest operation path according to the display content of the display screen;
acquiring a path identifier between the operation node and the next operation node according to the operation node;
searching corresponding pre-stored animation guide according to the path identifier to obtain a target animation guide corresponding to the shortest operation path; the pre-stored animation guide is used for guiding a user to operate on one operation node and switch to the next operation node.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
determining a return operation path of the menu to be displayed according to the current display content of the display screen and the menu to be displayed;
and generating the shortest operation path of the menu to be displayed according to the return operation path and the display operation path.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
acquiring a current display menu corresponding to current display content of a display screen, and determining a first cooking mode of the current display menu;
comparing the first cooking mode with a second cooking mode of a menu to be displayed;
and when the first cooking mode is determined to be inconsistent with the second cooking mode, determining the operation path of the main interface of the return display screen as the return operation path of the menu to be displayed.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
when the first cooking mode is determined to be consistent with the second cooking mode, acquiring a common superior operation node of a current display menu and a menu to be displayed;
and determining the operation path returning to the common upper operation node as the returning operation path of the menu to be displayed.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
acquiring operation nodes corresponding to display control operation of a menu to be displayed;
acquiring a standard tree structure corresponding to the display control operation of the cooking equipment;
and based on the standard tree structure, connecting each operation node to obtain a display operation path of the menu to be displayed.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
receiving a menu query instruction collected by cooking equipment;
analyzing a menu query instruction to obtain a menu to be displayed;
when the menu to be displayed is matched and stored, acquiring the current display content of a display screen of the cooking equipment and the display operation path of the menu to be displayed;
determining the shortest operation path for displaying the menu to be displayed according to the current display content and the display operation path of the display screen;
and determining a target animation guide corresponding to the shortest operation path, and playing the target animation guide on a display screen of the cooking equipment.
In one embodiment, the computer program when executed by the processor further performs the steps of:
determining an operation node corresponding to the shortest operation path according to the display content of the display screen;
acquiring a path identifier between the operation node and the next operation node according to the operation node;
searching corresponding pre-stored animation guide according to the path identifier to obtain a target animation guide corresponding to the shortest operation path; the pre-stored animation guide is used for guiding a user to operate on one operation node and switch to the next operation node.
In one embodiment, the computer program when executed by the processor further performs the steps of:
determining a return operation path of the menu to be displayed according to the current display content of the display screen and the menu to be displayed;
and generating the shortest operation path of the menu to be displayed according to the return operation path and the display operation path.
In one embodiment, the computer program when executed by the processor further performs the steps of:
acquiring a current display menu corresponding to current display content of a display screen, and determining a first cooking mode of the current display menu;
comparing the first cooking mode with a second cooking mode of a menu to be displayed;
and when the first cooking mode is determined to be inconsistent with the second cooking mode, determining the operation path of the main interface of the return display screen as the return operation path of the menu to be displayed.
In one embodiment, the computer program when executed by the processor further performs the steps of:
when the first cooking mode is determined to be consistent with the second cooking mode, acquiring a common superior operation node of a current display menu and a menu to be displayed;
and determining the operation path returning to the common upper operation node as the returning operation path of the menu to be displayed.
In one embodiment, the computer program when executed by the processor further performs the steps of:
acquiring operation nodes corresponding to display control operation of a menu to be displayed;
acquiring a standard tree structure corresponding to the display control operation of the cooking equipment;
and based on the standard tree structure, connecting each operation node to obtain a display operation path of the menu to be displayed.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (9)
1. A menu display method based on voice interaction is characterized by comprising the following steps:
receiving a menu query instruction collected by cooking equipment;
analyzing the menu query instruction to obtain a menu to be displayed;
when the menu to be displayed is matched and stored, acquiring the current display content of a display screen of the cooking equipment and the display operation path of the menu to be displayed;
determining the shortest operation path for displaying the menu to be displayed according to the current display content of the display screen and the display operation path;
determining a target animation guide corresponding to the shortest operation path, and playing the target animation guide on a display screen of the cooking equipment;
determining the mode of the target animation guide corresponding to the shortest operation path, wherein the mode comprises the following steps:
determining an operation node corresponding to the shortest operation path according to the display content of the display screen;
acquiring a path identifier between the operation node and the next operation node according to the operation node;
searching corresponding pre-stored animation guide according to the path identifier to obtain a target animation guide corresponding to the shortest operation path; the pre-stored animation guide is used for guiding a user to operate on one operation node and switch to the next operation node.
2. The method according to claim 1, wherein the determining a shortest operation path for displaying the menu to be displayed according to the current display content of the display screen and the display operation path comprises:
determining a return operation path of the menu to be displayed according to the current display content of the display screen and the menu to be displayed;
and generating the shortest operation path of the menu to be displayed according to the return operation path and the display operation path.
3. The method according to claim 2, wherein determining a way of returning to the operation path of the menu to be displayed according to the current display content of the display screen and the menu to be displayed comprises:
acquiring a current display menu corresponding to the current display content of the display screen, and determining a first cooking mode of the current display menu;
comparing the first cooking mode with a second cooking mode of the menu to be displayed;
and when the first cooking mode is determined to be inconsistent with the second cooking mode, determining an operation path of the main interface returned to the display screen as a return operation path of the menu to be displayed.
4. The method of claim 3, further comprising:
when the first cooking mode is determined to be consistent with the second cooking mode, acquiring a common superior operation node for displaying the current display menu and the menu to be displayed;
and determining the operation path returned to the common superior operation node as the return operation path of the menu to be displayed.
5. The method according to claim 1, wherein the manner of obtaining the display operation path of the menu to be displayed comprises:
acquiring each operation node corresponding to the display control operation of the menu to be displayed;
acquiring a standard tree structure corresponding to the display control operation of the cooking equipment;
and based on the standard tree structure, connecting the operation nodes to obtain a display operation path of the menu to be displayed.
6. A menu display apparatus based on voice interaction, the apparatus comprising:
the menu query instruction receiving module is used for receiving a menu query instruction collected by the cooking equipment;
the menu to be displayed acquisition module is used for analyzing the menu query instruction and acquiring a menu to be displayed;
the menu to be displayed matching module is used for acquiring the current display content of a display screen of the cooking equipment and the display operation path of the menu to be displayed when the menu to be displayed is matched and stored;
the shortest operation path determining module is used for determining the shortest operation path for displaying the menu to be displayed according to the current display content of the display screen and the display operation path;
the target animation guide playing module is used for determining a target animation guide corresponding to the shortest operation path and playing the target animation guide on a display screen of the cooking equipment;
the apparatus also includes a target animation direction generation module to:
determining an operation node corresponding to the shortest operation path according to the display content of the display screen;
acquiring a path identifier between the operation node and the next operation node according to the operation node;
searching corresponding pre-stored animation guide according to the path identifier to obtain a target animation guide corresponding to the shortest operation path; the pre-stored animation guide is used for guiding a user to operate on one operation node and switch to the next operation node.
7. The apparatus of claim 6, wherein the shortest operation path determining module is further configured to:
determining a return operation path of the menu to be displayed according to the current display content of the display screen and the menu to be displayed;
and generating the shortest operation path of the menu to be displayed according to the return operation path and the display operation path.
8. A cooking apparatus includes a cooking apparatus main body, a display apparatus, a sound collection apparatus, a memory, and a processor, the display apparatus, the sound collection apparatus, the memory, and the processor being provided on the cooking apparatus main body; the display equipment and the sound acquisition equipment are connected with the memory and the processor; the memory stores a computer program, characterized in that the processor implements the steps of the method of any one of claims 1 to 5 when executing the computer program.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010377582.0A CN111513584B (en) | 2020-05-07 | 2020-05-07 | Menu display method and device based on voice interaction and cooking equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010377582.0A CN111513584B (en) | 2020-05-07 | 2020-05-07 | Menu display method and device based on voice interaction and cooking equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111513584A CN111513584A (en) | 2020-08-11 |
| CN111513584B true CN111513584B (en) | 2021-04-23 |
Family
ID=71908384
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010377582.0A Active CN111513584B (en) | 2020-05-07 | 2020-05-07 | Menu display method and device based on voice interaction and cooking equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111513584B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101287265A (en) * | 2008-05-29 | 2008-10-15 | 德信无线通讯科技（北京）有限公司 | Virtual mobile phone for demonstration on interface and implementing method |
| CN105975256A (en) * | 2016-04-26 | 2016-09-28 | 广东小天才科技有限公司 | Operation guide method and system for application |
| CN108287739A (en) * | 2017-12-19 | 2018-07-17 | 维沃移动通信有限公司 | A kind of guiding method of operating and mobile terminal |
| CN109032731A (en) * | 2018-07-09 | 2018-12-18 | 西安电子科技大学 | A kind of voice interface method and system based on semantic understanding of oriented manipulation system |
| CN109947993A (en) * | 2019-03-14 | 2019-06-28 | 百度国际科技（深圳）有限公司 | Plot jump method, device and computer equipment based on speech recognition |
| CN110750161A (en) * | 2019-10-25 | 2020-02-04 | 郑子龙 | Interactive system, method, mobile device and computer readable medium |
| CN111080926A (en) * | 2019-12-09 | 2020-04-28 | 神思电子技术股份有限公司 | Auxiliary interaction method and device for self-service equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10929097B2 (en) * | 2018-06-26 | 2021-02-23 | ROVl GUIDES, INC. | Systems and methods for switching operational modes based on audio triggers |
-
2020
- 2020-05-07 CN CN202010377582.0A patent/CN111513584B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101287265A (en) * | 2008-05-29 | 2008-10-15 | 德信无线通讯科技（北京）有限公司 | Virtual mobile phone for demonstration on interface and implementing method |
| CN105975256A (en) * | 2016-04-26 | 2016-09-28 | 广东小天才科技有限公司 | Operation guide method and system for application |
| CN108287739A (en) * | 2017-12-19 | 2018-07-17 | 维沃移动通信有限公司 | A kind of guiding method of operating and mobile terminal |
| CN109032731A (en) * | 2018-07-09 | 2018-12-18 | 西安电子科技大学 | A kind of voice interface method and system based on semantic understanding of oriented manipulation system |
| CN109947993A (en) * | 2019-03-14 | 2019-06-28 | 百度国际科技（深圳）有限公司 | Plot jump method, device and computer equipment based on speech recognition |
| CN110750161A (en) * | 2019-10-25 | 2020-02-04 | 郑子龙 | Interactive system, method, mobile device and computer readable medium |
| CN111080926A (en) * | 2019-12-09 | 2020-04-28 | 神思电子技术股份有限公司 | Auxiliary interaction method and device for self-service equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111513584A (en) | 2020-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113133681B (en) | Cooking equipment, cooking control method and device thereof, and display control method | |
| CN109756787B (en) | Virtual gift generation method and device and virtual gift presentation system | |
| CN108447543A (en) | Menu method for pushing based on cooking equipment and device | |
| CN107872534B (en) | Information pushing method and device, server and readable storage medium | |
| CN109876440B (en) | Object display method and device, storage medium and electronic device | |
| KR20200136445A (en) | Ordering method and device, electronic equipment | |
| US20220343183A1 (en) | Human-computer interaction method and apparatus, storage medium and electronic device | |
| CN113055255A (en) | Scene configuration method and device of intelligent household appliance, storage medium and electronic equipment | |
| CN110075532A (en) | The control method and device of virtual objects, storage medium, electronic device | |
| CN110072147A (en) | Direct broadcasting room recommended method, device and storage medium | |
| CN111753049B (en) | Menu recommendation method and device, household electrical appliance and storage medium | |
| CN111355651A (en) | Content sharing method, display method, device, processing equipment and storage medium | |
| CN112782996A (en) | Equipment linkage method and device, storage medium and electronic device | |
| CN111513584B (en) | Menu display method and device based on voice interaction and cooking equipment | |
| US20150120705A1 (en) | Cuisine search device, cuisine search method, program, and computer-readable storage medium | |
| CN110363618A (en) | Recommended method, device and equipment | |
| CN112704873B (en) | Event processing method and device, storage medium and electronic equipment | |
| CN111766835A (en) | Cooking method, apparatus and storage medium | |
| CN113179416A (en) | Live content rebroadcasting method and related equipment | |
| CN116980706A (en) | Video playing method and device, storage medium and electronic equipment | |
| CN115082149A (en) | Electronic equipment, server and cooking equipment recommendation method | |
| CN113597623A (en) | Apparatus and method for determining cooking ability index | |
| CN110580636A (en) | Key setting method based on user behavior analysis, intelligent electric appliance and server | |
| CN111414396A (en) | Dish pushing method and device, storage medium and cooking equipment | |
| CN111275493B (en) | Processing method and device of list data, server and nonvolatile storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |