CN117573003A - Menu generation method, device, equipment and medium - Google Patents

Menu generation method, device, equipment and medium Download PDF

Info

Publication number
CN117573003A
CN117573003A CN202311504860.4A CN202311504860A CN117573003A CN 117573003 A CN117573003 A CN 117573003A CN 202311504860 A CN202311504860 A CN 202311504860A CN 117573003 A CN117573003 A CN 117573003A
Authority
CN
China
Prior art keywords
data
food material
image data
menu
food
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311504860.4A
Other languages
Chinese (zh)
Inventor
陈小平
李主荣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Foshan Viomi Electrical Technology Co Ltd
Original Assignee
Foshan Viomi Electrical Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Foshan Viomi Electrical Technology Co Ltd filed Critical Foshan Viomi Electrical Technology Co Ltd
Priority to CN202311504860.4A priority Critical patent/CN117573003A/en
Publication of CN117573003A publication Critical patent/CN117573003A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The embodiment of the invention discloses a menu generation method, a device, equipment and a medium, wherein the method comprises the following steps: acquiring the running state of a food material storage device, and acquiring image data of each food material in the food material storage device and freshness data corresponding to the image data when the running state of the food material storage device is an interactive state; ordering the image data of all food materials in the food material storage device based on the freshness data, generating an interactive interface, and acquiring request information of a user for the image data set; determining category information of the request information based on the processing mode, wherein the category information comprises first category information for using food materials for dish making and second category information for cleaning the food materials; and when the request information is the first type of information, generating a menu according to the target food material data. And generating a menu by combining the actually stored food materials and the freshness data of the food materials with the user request, so that the acceptance of the menu by the user is improved.

Description

Menu generation method, device, equipment and medium
Technical Field
The invention relates to the technical field of intelligent home, in particular to a menu generation method, device, equipment and medium.
Background
With the development of scientific technology, for example, the space for food storage in a refrigerator is larger and larger, and the structure in a refrigerator is more and more complex, so that when more food is stored in the refrigerator or is placed in the inner corner of the refrigerator, the food is easy to be lost, resulting in deterioration of the food.
In the prior art, food material information of a plurality of devices is fused and then sent to a server, so that the server can conduct menu recommendation (menu generation) based on the fused food material information of the plurality of devices in the home local area network, and cannot combine actual conditions, namely, the variety of food materials exists in a refrigerator, the freshness of the food materials is recommended to a user, meanwhile, the requirement of the user is ignored, and the recommended menu is often not accepted by the user, so that the acceptance of the menu recommendation is low.
Disclosure of Invention
In view of the above, the present invention provides a menu generating method, apparatus, device and medium for solving the problem that the recommended menu in the prior art is often not accepted by the user.
To achieve one or a part or all of the above or other objects, the present invention provides a menu generating method, comprising:
Acquiring the running state of a food material storage device, and acquiring image data of each food material in the food material storage device and freshness data corresponding to the image data when the running state of the food material storage device is an interactive state;
based on the freshness data, ordering the image data of all food materials in the food material storage device to obtain an image data set;
generating an interactive interface according to the image data set, and acquiring request information of a user aiming at the image data set through the interactive interface, wherein the request information comprises target food material data to be processed and a processing mode aiming at the target food material data;
determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials for making dishes and second category information representing food materials for cleaning;
and when the request information is the first type of information, generating a menu according to the target food material data.
Optionally, the step of sorting the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set includes:
Acquiring first habit data of a user, wherein the first habit data comprises food preference materials and food aversion materials;
arranging image data of all food materials in the food material storage device according to the sequence from spoilage to freshness based on the freshness data to obtain an initial image data set;
and adjusting the initial image data set according to the first habit data to obtain the image data set.
Optionally, when the request information is the first type information, the step of generating a menu according to the target food material data includes:
when the request information is the first type of information, second habit data of the user is obtained, wherein the second habit data is diet habit data aiming at a cooking mode;
generating an initial menu according to the target food material data and the second habit data;
acquiring health data of the user, and determining ingestion data for the user based on the health data;
and sequencing each dish in the initial menu based on the intake data and the nutritional component data of each dish in the initial menu to obtain the menu.
Optionally, the step of sorting the dishes in the initial menu based on the intake data and the nutritional component data of the dishes in the initial menu to obtain the menu includes:
Comparing the intake data with the nutritional ingredient data of each dish in the initial menu to obtain the matching degree of the nutritional ingredient data of each dish and the intake data;
and sequencing all dishes in the initial menu according to the sequence from the big degree to the small degree of matching to obtain the menu.
Optionally, after the step of generating a menu according to the target food material data when the request information is the first type of information, the method further includes:
when the type of the target food material data in the request information is not one, acquiring preset conflict recipe data, wherein the conflict recipe data comprises conflict food material pairs which cannot be eaten at the same time;
and verifying the menu based on the preset conflict recipe data, and deleting dishes corresponding to the conflict food pairs from the menu if the conflict food pairs in the conflict recipe data exist in the menu, so as to obtain the verified menu.
Optionally, the step of acquiring the operation state of the food material storage device includes:
acquiring real image data in a preset range right in front of the food storage device;
determining whether a target user directly viewing the food storage device exists in the real image data through a face recognition technology and a sight tracking technology;
If the target user exists in the real image data, controlling the food storage device to enter an interaction state, and acquiring the running state of the food storage device to be the interaction state;
and if the target user does not exist in the real image data, acquiring the power data of the food material storage device, and judging that the running state of the food material storage device is an on state or a standby state based on the power data.
Optionally, the step of acquiring the image data of each food material in the food material storage device and the freshness data corresponding to the image data includes:
dividing the food storage device into at least two sub-areas according to a storage space, and acquiring initial image data of each sub-area;
dividing image data of each food material in the food material storage device based on the initial image data;
inputting the image data into a preset recognition model to obtain freshness data corresponding to the image data, wherein the preset recognition model is a neural network model trained by multiple groups of data, and each group of data in the multiple groups of data comprises a preset food material image and preset freshness data corresponding to the preset food material image.
In another aspect, an embodiment of the present application provides a menu generating apparatus, including:
the data acquisition module is used for acquiring the running state of the food material storage device, and acquiring the image data of each food material in the food material storage device and the freshness data corresponding to the image data when the running state of the food material storage device is an interactive state;
the sorting module is used for sorting the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set;
the interaction module is used for generating an interaction interface according to the image data set, and acquiring request information of a user for the image data set through the interaction interface, wherein the request information comprises target food material data to be processed and a processing mode for the target food material data;
the classification module is used for determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials used for making dishes and second category information representing food materials to be cleaned;
and the generation module is used for generating a menu according to the target food material data when the request information is the first type of information.
In another aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory and a bus, said memory storing machine readable instructions executable by said processor, said processor and said memory communicating via said bus when the electronic device is running, said machine readable instructions when executed by said processor performing the steps of the menu generating method as described above.
In another aspect, embodiments of the present application provide a computer readable storage medium, where a computer program is stored on the computer readable storage medium, the computer program when executed by a processor performs the steps of the menu generating method as described above.
The implementation of the embodiment of the invention has the following beneficial effects:
acquiring image data of each food material in the food material storage device and freshness data corresponding to the image data when the operation state of the food material storage device is an interactive state by acquiring the operation state of the food material storage device; ordering the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set; generating an interactive interface according to the image data set, and acquiring request information of a user aiming at the image data set through the interactive interface, wherein the request information comprises target food material data to be processed and a processing mode aiming at the target food material data; determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials used for making dishes and second category information representing food materials to be cleaned; and when the request information is the first type of information, generating a menu according to the target food material data. Through obtaining the freshness data of each food material in the food material storage device, and based on the freshness data show the food material for the user, the user of being convenient for directly perceivedly knows the food material that should eat or handle as soon as possible, and based on freshness data and user request information generation menu guarantees that each dish in the menu is the dish that the user needs, and then, the menu of production accords with the user requirement for the menu is accepted by the user more easily.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Wherein:
fig. 1 is a scene diagram of man-machine interaction in a menu generating method provided in an embodiment of the present application;
FIG. 2 is a flowchart of a menu generation method provided in an embodiment of the present application;
FIG. 3 is an interactive interface diagram of a menu generating method according to an embodiment of the present application;
fig. 4 is an application interface diagram of a menu generating method provided in an embodiment of the present application;
fig. 5 is a schematic structural diagram of a menu generating device according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The application provides a menu generation method, a menu generation device, electronic equipment and a storage medium.
The menu generating device can be integrated in a food storage device such as an intelligent refrigerator, and the intelligent refrigerator can be any one of a single-door refrigerator, a double-door refrigerator, a three-door refrigerator, a side-by-side refrigerator, a T-shaped side-by-side three-door refrigerator and a multi-door refrigerator by taking the intelligent refrigerator as an example, but the menu generating device is not limited to the intelligent refrigerator. The intelligent refrigerator can be directly or indirectly connected with the server in a wired or wireless communication mode, the server can be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, and a cloud server for providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, basic cloud computing services such as big data and an artificial intelligent platform.
For example, referring to fig. 1, the menu generating device is integrated on the refrigerator 10, the refrigerator 10 may include a display screen, and a user may interact with the refrigerator 10 by touching the display screen of the refrigerator 10. In the process of controlling the refrigerator 10, a menu generating device in the refrigerator 10 acquires image data of each food material in the food material storage device (the refrigerator 10) and freshness data corresponding to the image data by acquiring the operation state of the food material storage device (the refrigerator 10) when the operation state of the food material storage device (the refrigerator 10) is an interaction state; ordering the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set; generating an interactive interface according to the image data set, and acquiring request information of a user aiming at the image data set through the interactive interface, wherein the request information comprises target food material data to be processed and a processing mode aiming at the target food material data; determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials used for making dishes and second category information representing food materials to be cleaned; and when the request information is the first type of information, generating a menu according to the target food material data.
Wherein the menu generating means comprises: a processor, configured to acquire an operation state of a food material storage device (refrigerator 10), and acquire image data of each food material in the food material storage device (refrigerator 10) and freshness data corresponding to the image data when the operation state of the food material storage device (refrigerator 10) is an interaction state; ordering the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set; generating an interactive interface according to the image data set, and acquiring request information of a user aiming at the image data set through the interactive interface, wherein the request information comprises target food material data to be processed and a processing mode aiming at the target food material data; determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials used for making dishes and second category information representing food materials to be cleaned; when the request information is the first type of information, generating a menu according to the target food material data; a camera device (e.g., a camera) for capturing an image of food materials in the refrigerator 10 and transmitting the captured image of the food materials to the processor; the display device (for example, a display) is used for displaying an interactive interface, acquiring request information of a user for the image data set through the interactive interface and displaying the menu.
According to the menu generation method, the freshness data of each food material in the food material storage device are obtained, the food materials are displayed to the user based on the freshness data, the user can intuitively know the food materials which should be eaten or processed as soon as possible, and the menu is generated based on the freshness data and the user request information, so that each menu in the menu is ensured to be a menu required by the user, and the generated menu meets the user requirement, so that the menu is easier to accept by the user.
The following will describe in detail. It should be noted that the following description order of embodiments is not a limitation of the priority order of embodiments.
As shown in fig. 2, an embodiment of the present application provides a menu generating method, including:
s101, acquiring the running state of a food material storage device, and acquiring image data of each food material in the food material storage device and freshness data corresponding to the image data when the running state of the food material storage device is an interactive state;
the food material storage device is a device for delaying the period of changing the internal food material by keeping the environment such as the internal temperature constant, taking a refrigerator as an example, and acquiring food material images of the food material in the food material storage device according to a preset period, wherein the preset period can be a "day" or a "week", and the food material images are images of the food material in a unit quantity, such as an image of a carrot, an image of an apple and an image of a cup of milk.
The food material may be an edible article, or may be an article containing an edible component, for example, a mask to be stored in a refrigerator, a food with a packaging bag, or the like.
Illustratively, the process of obtaining the freshness data corresponding to the image data may be implemented by a preset neural network model, where the neural network model may use a matching algorithm, and the matching algorithm may be a neural network (BP) algorithm, and may include, but is not limited to: the neural network model is trained through image data of different kinds of food materials under different freshness degrees by using a minimum distance method, a maximum likelihood method, a mahalanobis distance method, a Support Vector Machine (SVM) and other algorithms, wherein the image data comprises a preset food material image and preset freshness data corresponding to the preset food material image, namely, a preset food material image with the freshness data, for example, a carrot image with the label information of 'fresh'.
For example, when the operation state of the food material storage device is an interaction state, an interaction interface is generated according to the display information, so that invalid display when a user does not interact with the food material storage device is avoided.
Illustratively, the freshness data includes: "fresh", "sub-spoil" and "spoil".
S102, sorting image data of all food materials in the food material storage device based on the freshness data to obtain an image data set;
by ordering the image data of all the food materials in the food material storage device based on the freshness data, for example, ordering the image data of all the food materials in the food material storage device in the order of "fresh" - "next spoilage" - "spoilage", it is possible for the user to intuitively understand the freshness of the currently displayed image data (food material), for example, the freshness of the first displayed image data (food material) to be "fresh" when the image data is displayed later.
S103, generating an interactive interface according to the image data set, and acquiring request information of a user for the image data set through the interactive interface, wherein the request information comprises target food material data to be processed and a processing mode for the target food material data;
by way of example, the display device displays each image data in the image dataset in sequence through the interactive interface, so that the requirement of parallel display on the size of a display is avoided, for example, the parallel display needs to display more image data at the same time, so that the display is required to be as large as possible to ensure the display effect, and the display device does not need to be required to be as large as possible when each image data in the image dataset is displayed in sequence, so that the requirement on hardware (display device) is reduced, and the applicability of the scheme is further improved.
Illustratively, as shown in fig. 3, the interactive interface includes a display area for displaying the image dataset and a function key representing a food material processing mode, where the function key representing the food material processing mode, for example, a delete key, represents discarding the selected food material, or a process key, represents taking out and processing the selected food material.
S104, determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials used for making dishes and second category information representing food materials to be cleaned;
for example, when the processing manner is a processing manner representing discarding of the selected food material, for example, a processing manner such as cleaning, deleting, etc., the category information of the request information is considered as the second category information; when the processing method is a processing method representing processing of the selected food, for example, cooking, pickling, or the like, the type information of the request information is considered to be the first type information.
And S105, when the request information is the first type of information, generating a menu according to the target food material data.
For example, when the request information is the first type of information, the user is considered to want to cook and process the target food, and then a menu is generated according to the target food selected by the user.
Acquiring image data of each food material in the food material storage device and freshness data corresponding to the image data when the operation state of the food material storage device is an interactive state by acquiring the operation state of the food material storage device; ordering the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set; generating an interactive interface according to the image data set, and acquiring request information of a user aiming at the image data set through the interactive interface, wherein the request information comprises target food material data to be processed and a processing mode aiming at the target food material data; determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials used for making dishes and second category information representing food materials to be cleaned; and when the request information is the first type of information, generating a menu according to the target food material data. Through obtaining the freshness data of each food material in the food material storage device, and based on the freshness data show the food material for the user, the user of being convenient for directly perceivedly knows the food material that should eat or handle as soon as possible, and based on freshness data and user request information generation menu guarantees that each dish in the menu is the dish that the user needs, and then, the menu of production accords with the user requirement for the menu is accepted by the user more easily.
In one possible implementation manner, the step of sorting the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set includes:
acquiring first habit data of a user, wherein the first habit data comprises food preference materials and food aversion materials;
arranging image data of all food materials in the food material storage device according to the sequence from spoilage to freshness based on the freshness data to obtain an initial image data set;
and adjusting the initial image data set according to the first habit data to obtain the image data set.
The first habit data is food preference data for food materials, and may be taste preference (sweet taste, salty taste), food material preference (like eating potato, dislike eating celery) and the like of the user, where the first habit data is preference data of the user for food materials, and obtains user preference food materials and aversion food materials, for example, the preference food materials are potato and celery; the aversive food material is carrot; the image data of all food materials in the food material storage device are firstly arranged according to the sequence from spoilage to freshness based on the freshness data, so as to obtain an initial image data set, for example. The initial image data set is "broccoli, carrot, leek, tomato, potato and celery", and is adjusted according to the favorite food materials and the disliked food materials (first habit data) of the user, and the obtained image data set is "potato, celery, broccoli, leek, tomato and carrot". Combines the preference of the user and the freshness data of the food materials, and is more humanized.
In one possible implementation manner, when the request information is the first type of information, the step of generating a menu according to the target food material data includes:
when the request information is the first type of information, second habit data of the user is obtained, wherein the second habit data is diet habit data aiming at a cooking mode;
generating an initial menu according to the target food material data and the second habit data;
acquiring health data of the user, and determining ingestion data for the user based on the health data;
and sequencing each dish in the initial menu based on the intake data and the nutritional component data of each dish in the initial menu to obtain the menu.
For example, the target food material data (target food material) is determined according to the request information of the user, an initial menu is generated according to the cooking mode (second habit data) liked by the user, for example, the user selects potatoes as the target food material, the second habit data determines the cooking mode that the user likes to fry, and the generated initial menu comprises a plurality of dishes for cooking potatoes in the cooking mode of frying, for example, the initial menu is: fries, shredded potatoes and sliced potatoes.
The method includes the steps of obtaining health data of a target user, determining ingestion data of the target user based on the health data, for example, determining that the ingestion data of grease of the target user is not higher than a reasonable value if the health data of the user is in a sub-health state, and adjusting the position of the fries in the initial menu if the content of grease in the nutritional ingredient data of the fries is higher than the reasonable value, so that the menu is obtained as fried shredded potatoes, fried potato slices and fried fries.
In a possible implementation manner, the step of sorting the dishes in the initial menu based on the intake data and the nutritional component data of the dishes in the initial menu to obtain the menu includes:
comparing the intake data with the nutritional ingredient data of each dish in the initial menu to obtain the matching degree of the nutritional ingredient data of each dish and the intake data;
and sequencing all dishes in the initial menu according to the sequence from the big degree to the small degree of matching to obtain the menu.
For example, the intake data often consists of a variety of data, including, for example: vitamin intake, protein intake, and oil intake; the nutritional composition data for each dish includes: vitamin content, protein content and oil content; and then subtracting the vitamin intake and the vitamin content to obtain a difference value, subtracting the protein intake and the protein content to obtain a difference value as the vitamin matching degree, subtracting the oil intake and the oil content to obtain a difference value as the protein matching degree, and obtaining the oil matching degree.
The vitamin matching degree, the protein matching degree and the oil matching degree are added to obtain the matching degree of the nutritional ingredient data of each dish and the intake data, and the dishes in the initial menu are ordered according to the sequence from the big to the small matching degree to obtain the menu, so that the menu is easy to be accepted by a user, and meanwhile health and rationality are ensured.
In one possible implementation manner, after the step of generating a menu according to the target food material data when the request information is the first type of information, the method further includes:
when the type of the target food material data in the request information is not one, acquiring preset conflict recipe data, wherein the conflict recipe data comprises conflict food material pairs which cannot be eaten at the same time;
and verifying the menu based on the preset conflict recipe data, and deleting dishes corresponding to the conflict food pairs from the menu if the conflict food pairs in the conflict recipe data exist in the menu, so as to obtain the verified menu.
The preset conflict recipe data may be constructed by a network database, for example, a conflict food pair which cannot be eaten simultaneously, such as milk, pineapple, beef, chestnut, etc., if beef is used as a food in the menu, and chestnut is used as a food in the menu, the beef is used as the food in the menu, or the chestnut is used as the food in the menu, so that the safety of the menu is ensured.
In one possible embodiment, the step of obtaining the operation state of the food material storage device includes:
acquiring real image data in a preset range right in front of the food storage device;
determining whether a target user directly viewing the food storage device exists in the real image data through a face recognition technology and a sight tracking technology;
if the target user exists in the real image data, controlling the food storage device to enter an interaction state, and acquiring the running state of the food storage device to be the interaction state;
and if the target user does not exist in the real image data, acquiring the power data of the food material storage device, and judging that the running state of the food material storage device is an on state or a standby state based on the power data.
The face orientation of the user is determined through the face recognition technology, whether the current line of sight of the user pays attention to the food storage device (whether the user looks at the food storage device directly) is determined based on the line of sight tracking technology, and when the user looks at the food storage device directly, the food storage device generates an interactive interface based on display information, namely, when the user looks at the food storage device, display of the display information is performed, and the food storage device is prevented from displaying the display information in real time, so that resource waste is caused.
For example, if the target user does not exist in the real image data, the operating state of the food storage device is judged to be an on state or a standby state according to the power data of the food storage device and the operating rule of the food storage device, for example, when the food storage device is in the standby state, the power is lower and is maintained at low power for a long time, and when the food storage device is in the on state, the power is higher than the power in the standby state and has variability.
In one possible embodiment, the step of acquiring image data of each food material in the food material storage device and freshness data corresponding to the image data includes:
dividing the food storage device into at least two sub-areas according to a storage space, and acquiring initial image data of each sub-area;
dividing image data of each food material in the food material storage device based on the initial image data;
inputting the image data into a preset recognition model to obtain freshness data corresponding to the image data, wherein the preset recognition model is a neural network model trained by multiple groups of data, and each group of data in the multiple groups of data comprises a preset food material image and preset freshness data corresponding to the preset food material image.
Illustratively, the sub-area is a food material storage area in the refrigerator, and the target area may be a refrigeration area or a freezing area.
The refrigerated area may be divided into a plurality of sub-refrigerated areas, i.e. the target area may be at least one of the individual sub-refrigerated areas, each sub-refrigerated area may be used for storing a type of food material.
The refrigerated area can be used for storing vegetables such as spinach, celery, rape, broccoli, cauliflower, beans, cucumber, carrot, tomato, onion, etc., and also for storing fruits such as apples, pears, bananas, grapes, strawberries, blueberries, peaches, oranges, etc.; or for storing meat and seafood such as beef, pork, chicken, duck, fish, shrimp, etc.; or for storing milk products and eggs, such as milk, yoghurt, cheese, butter, eggs etc. in breakfast.
The frozen region may be divided into a plurality of sub-frozen regions, i.e. the target region may be at least one of the individual sub-frozen regions, each sub-frozen region being available for storing a type of foodstuff.
Illustratively, the target area includes a sub-freezing area a, a sub-freezing area B, and a sub-freezing area C, and when detecting that the user stores dumplings in the sub-freezing area B, and the user stores shrimps in the sub-freezing area C, the sub-freezing area B and the sub-freezing area C are confirmed as target areas, and the refrigerator monitors liquid change data and gas change data of the sub-freezing area B and the sub-freezing area C.
The freezing area can be used for storing quick-frozen food materials of aquatic products, such as fish, shrimp, crab meat sticks and the like; the method can also be used for storing quick-frozen food materials of fruits and vegetables, such as bamboo shoots, green soy beans and the like; it can also be used for producing quick-frozen food materials such as pork, chicken, etc., or for storing conditioning quick-frozen food materials such as cooked wheaten food glutinous rice balls, boiled dumplings, steamed stuffed bun, chafing dish flavoring fish dumplings, fish balls, tribute balls, flour-coated fried chicken nuggets, squid steaks, dish cooking food, etc.
Illustratively, as shown in fig. 4, the refrigerator includes a refrigerating area a including sub-refrigerating areas A1 to a sub-refrigerating area a10, and a freezing area B; the frozen region B includes sub-frozen regions B1 to B6.
Exemplary, before the step of inputting the food material image into a preset recognition model to obtain the first freshness data corresponding to the food material image, the method further includes:
acquiring a food material picture training set from a preset food material picture database, wherein the food material picture training set comprises a preset food material image and preset freshness data corresponding to the preset food material image;
training a pre-constructed neural network model through the food material picture training set to obtain an initial preset identification model, and recording the type data of each preset food material image in the food material picture training set as preset type data;
Acquiring type data of food materials in the food material storage device as target type data;
matching the preset type data with the target type data, and if the target type data is a subset of the preset type data, using the initial preset recognition model as the preset recognition model, and continuously inputting the food material image into the preset recognition model to obtain the freshness data of the food materials;
if the target type data is not a subset of the preset type data, acquiring a target food material picture training set from a preset food material picture database based on the target type data, and training the initial preset recognition model based on the target food material picture training set to obtain the preset recognition model.
The preset food material picture database may be constructed by acquiring network resources, and in the process of acquiring the food material picture training set from the preset food material picture database, it is required to ensure that the food material types in the food material picture training set are common and rich, for example, preset food material images of types such as onion, ginger, garlic, rice, flour and the like common to daily life and preset freshness data corresponding to the preset food material images should exist in the food material picture training set, so as to ensure accuracy and applicability of the initial preset identification model.
For example, since the eating habits of different regions are different, the types of food materials stored in different regions are often different, in order to ensure that the preset recognition model can still recognize freshness data when facing a certain special food material, the type data of the food materials in the food material storage device is obtained, the type data is taken as target type data, a food material picture training set is reconstructed in the preset food material picture database based on the target type data, and the initial preset recognition model is trained through the reconstructed food material picture training set, so as to obtain the preset recognition model, for example, in some Guizhou regions, the eating habits of people comprise the zebra root, therefore, in order to ensure that the preset recognition model can still recognize freshness data of the zebra root when facing the zebra root, the food material picture training set containing the zebra root needs to be reconstructed in the preset food material picture database, and the initial preset recognition model is trained through the food material picture training set containing the zebra root, so as to obtain the preset recognition model.
The initial preset recognition model is trained by food material images of food materials which are commonly used in daily life, so that the wide applicability of the food material freshness recognition is guaranteed, and the preset recognition model is trained by food material pictures of specific food materials, so that the method has pertinence and meets the actual requirements.
In a possible implementation manner, as shown in fig. 5, an embodiment of the present application provides a menu generating device, where the device includes:
the data acquisition module 201 is configured to acquire an operation state of the food material storage device, and acquire image data of each food material in the food material storage device and freshness data corresponding to the image data when the operation state of the food material storage device is an interaction state;
a sorting module 202, configured to sort image data of all food materials in the food material storage device based on the freshness data, so as to obtain an image dataset;
the interaction module 203 is configured to generate an interaction interface according to the image dataset, and obtain, through the interaction interface, request information of a user for the image dataset, where the request information includes target food material data to be processed and a processing manner for the target food material data;
a classification module 204, configured to determine, based on the processing manner, category information of the request information, where the category information includes first category information representing that food materials are used for making dishes and second category information representing that the food materials are cleaned;
and the generating module 205 is configured to generate a menu according to the target food material data when the request information is the first type of information.
Acquiring image data of each food material in the food material storage device and freshness data corresponding to the image data when the operation state of the food material storage device is an interactive state by acquiring the operation state of the food material storage device; ordering the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set; generating an interactive interface according to the image data set, and acquiring request information of a user aiming at the image data set through the interactive interface, wherein the request information comprises target food material data to be processed and a processing mode aiming at the target food material data; determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials used for making dishes and second category information representing food materials to be cleaned; and when the request information is the first type of information, generating a menu according to the target food material data. Through obtaining the freshness data of each food material in the food material storage device, and based on the freshness data show the food material for the user, the user of being convenient for directly perceivedly knows the food material that should eat or handle as soon as possible, and based on freshness data and user request information generation menu guarantees that each dish in the menu is the dish that the user needs, and then, the menu of production accords with the user requirement for the menu is accepted by the user more easily.
In one possible implementation, as shown in fig. 6, an embodiment of the present application provides an electronic device 300, including: comprising a memory 310, a processor 320 and a computer program 311 stored on the memory 310 and executable on the processor 320, the processor 320 implementing, when executing the computer program 311: acquiring the running state of a food material storage device, and acquiring image data of each food material in the food material storage device and freshness data corresponding to the image data when the running state of the food material storage device is an interactive state; ordering the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set; generating an interactive interface according to the image data set, and acquiring request information of a user aiming at the image data set through the interactive interface, wherein the request information comprises target food material data to be processed and a processing mode aiming at the target food material data; determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials used for making dishes and second category information representing food materials to be cleaned; and when the request information is the first type of information, generating a menu according to the target food material data.
Acquiring image data of each food material in the food material storage device and freshness data corresponding to the image data when the operation state of the food material storage device is an interactive state by acquiring the operation state of the food material storage device; ordering the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set; generating an interactive interface according to the image data set, and acquiring request information of a user aiming at the image data set through the interactive interface, wherein the request information comprises target food material data to be processed and a processing mode aiming at the target food material data; determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials used for making dishes and second category information representing food materials to be cleaned; and when the request information is the first type of information, generating a menu according to the target food material data. Through obtaining the freshness data of each food material in the food material storage device, and based on the freshness data show the food material for the user, the user of being convenient for directly perceivedly knows the food material that should eat or handle as soon as possible, and based on freshness data and user request information generation menu guarantees that each dish in the menu is the dish that the user needs, and then, the menu of production accords with the user requirement for the menu is accepted by the user more easily.
In one possible implementation, as shown in fig. 7, the present embodiment provides a computer-readable storage medium 400, on which is stored a computer program 411, which computer program 411, when executed by a processor, implements: acquiring the running state of a food material storage device, and acquiring image data of each food material in the food material storage device and freshness data corresponding to the image data when the running state of the food material storage device is an interactive state; ordering the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set; generating an interactive interface according to the image data set, and acquiring request information of a user aiming at the image data set through the interactive interface, wherein the request information comprises target food material data to be processed and a processing mode aiming at the target food material data; determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials used for making dishes and second category information representing food materials to be cleaned; and when the request information is the first type of information, generating a menu according to the target food material data.
Acquiring image data of each food material in the food material storage device and freshness data corresponding to the image data when the operation state of the food material storage device is an interactive state by acquiring the operation state of the food material storage device; ordering the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set; generating an interactive interface according to the image data set, and acquiring request information of a user aiming at the image data set through the interactive interface, wherein the request information comprises target food material data to be processed and a processing mode aiming at the target food material data; determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials used for making dishes and second category information representing food materials to be cleaned; and when the request information is the first type of information, generating a menu according to the target food material data. Through obtaining the freshness data of each food material in the food material storage device, and based on the freshness data show the food material for the user, the user of being convenient for directly perceivedly knows the food material that should eat or handle as soon as possible, and based on freshness data and user request information generation menu guarantees that each dish in the menu is the dish that the user needs, and then, the menu of production accords with the user requirement for the menu is accepted by the user more easily.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium may be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, and the like, or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
It will be appreciated by those of ordinary skill in the art that the modules or steps of the invention described above may be implemented in a general purpose computing device, they may be centralized on a single computing device, or distributed over a network of computing devices, or they may alternatively be implemented in program code executable by a computer device, such that they are stored in a memory device and executed by the computing device, or they may be separately fabricated as individual integrated circuit modules, or multiple modules or steps within them may be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of numerous obvious changes, rearrangements and substitutions without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
The foregoing disclosure is illustrative of the present invention and is not to be construed as limiting the scope of the invention, which is defined by the appended claims.

Claims (10)

1. A menu generating method, comprising:
acquiring the running state of a food material storage device, and acquiring image data of each food material in the food material storage device and freshness data corresponding to the image data when the running state of the food material storage device is an interactive state;
Based on the freshness data, ordering the image data of all food materials in the food material storage device to obtain an image data set;
generating an interactive interface according to the image data set, and acquiring request information of a user aiming at the image data set through the interactive interface, wherein the request information comprises target food material data to be processed and a processing mode aiming at the target food material data;
determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials for making dishes and second category information representing food materials for cleaning;
and when the request information is the first type of information, generating a menu according to the target food material data.
2. The menu generating method of claim 1, wherein the step of sorting image data of all food materials in the food material storage device based on the freshness data to obtain an image data set comprises:
acquiring first habit data of a user, wherein the first habit data comprises food preference materials and food aversion materials;
arranging image data of all food materials in the food material storage device according to the sequence from spoilage to freshness based on the freshness data to obtain an initial image data set;
And adjusting the initial image data set according to the first habit data to obtain the image data set.
3. The menu generating method of claim 2, wherein the step of generating a menu from the target food material data when the request information is the first type of information comprises:
when the request information is the first type of information, second habit data of the user is obtained, wherein the second habit data is diet habit data aiming at a cooking mode;
generating an initial menu according to the target food material data and the second habit data;
acquiring health data of the user, and determining ingestion data for the user based on the health data;
and sequencing all dishes in the initial menu based on the intake data and the nutritional ingredient data of all dishes in the initial menu to obtain the menu.
4. A menu generating method as claimed in claim 3, wherein said step of sorting each dish in said initial menu based on said intake data and nutritional composition data of each dish in said initial menu to obtain said menu comprises:
Comparing the intake data with the nutritional ingredient data of each dish in the initial menu to obtain the matching degree of the nutritional ingredient data of each dish and the intake data;
and sequencing all dishes in the initial menu according to the sequence from the big degree to the small degree of matching to obtain the menu.
5. The menu generating method of claim 1, further comprising, after the step of generating a menu from the target food material data when the request information is the first type of information:
when the type of the target food material data in the request information is not one, acquiring preset conflict recipe data, wherein the conflict recipe data comprises conflict food material pairs which cannot be eaten at the same time;
and verifying the menu based on the preset conflict recipe data, and deleting dishes corresponding to the conflict food pairs from the menu if the conflict food pairs in the conflict recipe data exist in the menu, so as to obtain the verified menu.
6. The menu generating method of claim 1, wherein the step of acquiring the operation state of the food material storage device comprises:
acquiring real image data in a preset range right in front of the food storage device;
Determining whether a target user directly viewing the food storage device exists in the real image data through a face recognition technology and a sight tracking technology;
if the target user exists in the real image data, controlling the food storage device to enter an interaction state, and acquiring the running state of the food storage device to be the interaction state;
and if the target user does not exist in the real image data, acquiring the power data of the food material storage device, and judging that the running state of the food material storage device is an on state or a standby state based on the power data.
7. The menu generating method of claim 1, wherein the step of acquiring image data of each food material in the food material storage device, and freshness data corresponding to the image data, comprises:
dividing the food storage device into at least two sub-areas according to a storage space, and acquiring initial image data of each sub-area;
dividing image data of each food material in the food material storage device based on the initial image data;
inputting the image data into a preset recognition model to obtain freshness data corresponding to the image data, wherein the preset recognition model is a neural network model trained by multiple groups of data, and each group of data in the multiple groups of data comprises a preset food material image and preset freshness data corresponding to the preset food material image.
8. A menu generating apparatus, the apparatus comprising:
the data acquisition module is used for acquiring the running state of the food material storage device, and acquiring the image data of each food material in the food material storage device and the freshness data corresponding to the image data when the running state of the food material storage device is an interactive state;
the sorting module is used for sorting the image data of all food materials in the food material storage device based on the freshness data to obtain an image data set;
the interaction module is used for generating an interaction interface according to the image data set, and acquiring request information of a user for the image data set through the interaction interface, wherein the request information comprises target food material data to be processed and a processing mode for the target food material data;
the classification module is used for determining category information of the request information based on the processing mode, wherein the category information comprises first category information representing food materials used for making dishes and second category information representing food materials to be cleaned;
and the generation module is used for generating a menu according to the target food material data when the request information is the first type of information.
9. An electronic device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory in communication via the bus when the electronic device is running, the machine-readable instructions when executed by the processor performing the steps of the menu generating method of any one of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, performs the steps of the menu generating method according to any of claims 1 to 7.
CN202311504860.4A 2023-11-10 2023-11-10 Menu generation method, device, equipment and medium Pending CN117573003A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311504860.4A CN117573003A (en) 2023-11-10 2023-11-10 Menu generation method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311504860.4A CN117573003A (en) 2023-11-10 2023-11-10 Menu generation method, device, equipment and medium

Publications (1)

Publication Number Publication Date
CN117573003A true CN117573003A (en) 2024-02-20

Family

ID=89863561

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311504860.4A Pending CN117573003A (en) 2023-11-10 2023-11-10 Menu generation method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN117573003A (en)

Similar Documents

Publication Publication Date Title
US20220005376A1 (en) Systems and methods to mimic target food items using artificial intelligence
US20190295440A1 (en) Systems and methods for food analysis, personalized recommendations and health management
US9489377B1 (en) Inferring recipe difficulty
US20190034556A1 (en) Method, apparatus and refrigerator for recipe recommendation
JP6336211B2 (en) Temperature control method and apparatus, program, and recording medium
US9797873B1 (en) Prediction of recipe preparation time
US20160196337A1 (en) Iterative image search algorithm informed by continuous human-machine input feedback
US11521734B2 (en) Recipe generation based on neural network
CN105809598A (en) Dietary intake management method, device and cloud platform
US20130149675A1 (en) System and methods for virtual cooking
US20130149676A1 (en) System and methods for virtual cooking with recipe matching
US20130149678A1 (en) System and methods for virtual cooking with multi-course planning
US20130149677A1 (en) System and methods for virtual cooking with food pairing
US10861076B1 (en) Methods, systems, and devices for generating a refreshment instruction set based on individual preferences
US20200397194A1 (en) Configurable meal kit preparation and storage vehicle
CN110223759A (en) A kind of dietary management system and method
CN108492861A (en) Accurate diet system for prompting and method
CN113158018A (en) Recipe recommendation method, refrigerator and computer-readable storage medium
Noever et al. The multimodal and modular ai chef: Complex recipe generation from imagery
Alçiçek et al. Characterization of green shelled mussel meat. Part I: Quantification of color changes during brining and liquid smoke application using image analysis
CN117573003A (en) Menu generation method, device, equipment and medium
WO2020181722A1 (en) Recipe recommendation method and device for refrigerator
CN117573692A (en) Food material indicating method, device, equipment and medium
CN111292829A (en) Method, device, equipment and medium for dietary health management/food nutrition
KR102481874B1 (en) Dietary management device, dietary management method, dietary management program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination