CN112185510A - Food material recommendation management method and device and refrigerator - Google Patents

Food material recommendation management method and device and refrigerator Download PDF

Info

Publication number
CN112185510A
CN112185510A CN201910599479.8A CN201910599479A CN112185510A CN 112185510 A CN112185510 A CN 112185510A CN 201910599479 A CN201910599479 A CN 201910599479A CN 112185510 A CN112185510 A CN 112185510A
Authority
CN
China
Prior art keywords
food material
missing
material information
nutrient elements
refrigerator
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910599479.8A
Other languages
Chinese (zh)
Inventor
高进宝
俞国新
高洪波
刘彦甲
刘兵
李玉强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Guochuang Intelligent Home Appliance Research Institute Co ltd
Qingdao Haier Smart Technology R&D Co Ltd
Haier Smart Home Co Ltd
Original Assignee
Qingdao Guochuang Intelligent Home Appliance Research Institute Co ltd
Qingdao Haier Smart Technology R&D Co Ltd
Haier Smart Home Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Guochuang Intelligent Home Appliance Research Institute Co ltd, Qingdao Haier Smart Technology R&D Co Ltd, Haier Smart Home Co Ltd filed Critical Qingdao Guochuang Intelligent Home Appliance Research Institute Co ltd
Priority to CN201910599479.8A priority Critical patent/CN112185510A/en
Publication of CN112185510A publication Critical patent/CN112185510A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/60ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to nutrition control, e.g. diets

Landscapes

  • Health & Medical Sciences (AREA)
  • Nutrition Science (AREA)
  • Engineering & Computer Science (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

The application relates to the technical field of intelligent equipment and discloses a method for recommending and managing food materials. The method comprises the following steps: acquiring a current refrigerator user image; determining the taken food material information corresponding to the current refrigerator user image through image identification; and under the condition that the nutrient elements of the taken food material information have missing nutrient elements according to a preset nutrient balance condition, warning and reminding of the missing nutrient elements are carried out. Therefore, the probability of unbalanced nutrition of the user is reduced, personalized recommendation management of food materials is realized, and the intelligence of the refrigerator is further improved. The application also discloses a device for recommending and managing food materials and a refrigerator.

Description

Food material recommendation management method and device and refrigerator
Technical Field
The application relates to the technical field of intelligent equipment, in particular to a method and a device for food material recommendation management and a refrigerator.
Background
With the progress of scientific technology and the development of artificial intelligence, an intelligent algorithm is also increasingly applied to daily life, particularly for a refrigerator, the intelligent development of the intelligent algorithm is crucial as one of daily household appliances with high use frequency, and the key problem of intelligence lies in intelligently solving the urgent needs of users.
At present, many requirements of refrigerator users are not met, such as: personalized recommendation and management of food materials are realized, and therefore, the intelligent function of the refrigerator is still to be improved.
Disclosure of Invention
The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosed embodiments. This summary is not an extensive overview nor is intended to identify key/critical elements or to delineate the scope of such embodiments but rather as a prelude to the more detailed description that is presented later.
The embodiment of the disclosure provides a food material recommendation management method, a food material recommendation management device and a refrigerator, and aims to solve the technical problem that the intellectualization of the refrigerator needs to be improved.
In some embodiments, the method comprises:
acquiring a current refrigerator user image;
determining the taken food material information corresponding to the current refrigerator user image through image identification;
and under the condition that the nutrient elements of the taken food material information have nutrient elements which are missing according to a preset nutrient balance condition, warning and reminding of the missing nutrient elements are carried out.
In some embodiments, the apparatus comprises:
the image acquisition module is configured to acquire a current refrigerator user image;
the information determining module is configured to determine the taken food material information corresponding to the current refrigerator user image through image recognition;
and the warning management module is configured to perform warning reminding of the missing nutrient elements under the condition that the missing nutrient elements exist in the nutrient elements from which the food material information is taken out according to a preset nutrient balance condition.
In some embodiments, the refrigerator includes: the food material management device.
The method for recommending and managing food materials, the device for recommending and managing food materials and the refrigerator provided by the embodiment of the disclosure can achieve the following technical effects:
the method and the device have the advantages that missing nutrient elements in the nutrient elements of the food material information which is taken out can be determined according to the food material information which is taken out and matched by the user and the preset nutrient balance condition, warning reminding is carried out, the probability of unbalanced nutrition of the user is reduced, personalized recommendation management of food materials is realized, the intelligence of the refrigerator is further improved, the probability of damage to the body of the user due to unbalanced nutrition is also reduced, and the user experience is improved.
The foregoing general description and the following description are exemplary and explanatory only and are not restrictive of the application.
Drawings
One or more embodiments are illustrated in the accompanying drawings, which correspond to the accompanying drawings, and which do not constitute a limitation on the embodiments, in which elements having the same reference numeral designations are shown as similar elements, and in which:
fig. 1 is a flowchart illustrating a food material recommendation management method according to an embodiment of the disclosure;
fig. 2 is a flowchart illustrating a food material recommendation management method according to an embodiment of the disclosure;
fig. 3 is a flowchart illustrating a food material recommendation management method according to an embodiment of the disclosure;
fig. 4 is a schematic structural diagram of a food material recommendation management apparatus according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a food material recommendation management apparatus according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of a food material recommendation management apparatus provided in an embodiment of the present disclosure.
Detailed Description
So that the manner in which the features and aspects of the disclosed embodiments can be understood in detail, a more particular description of the disclosed embodiments, briefly summarized above, may be had by reference to the embodiments, some of which are illustrated in the appended drawings. In the following description of the technology, for purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the disclosed embodiments. However, one or more embodiments may be practiced without these details. In other instances, well-known structures and devices may be shown in simplified form in order to simplify the drawing.
In the embodiment of the disclosure, the refrigerator can determine the taken food material information matched with the refrigerator user, and preset nutrition balance conditions, determine missing nutritional elements existing in the nutritional elements of the taken food material information, warn and remind the user, reduce the probability of unbalanced nutrition, realize personalized recommendation and management of food materials, further improve the intelligence of the refrigerator, reduce the probability of damaging the body of the user, and improve the user experience.
Fig. 1 is a flowchart illustrating a food material recommendation management method according to an embodiment of the disclosure. As shown in fig. 1, the process of food material recommendation management includes:
step 101: and acquiring a current refrigerator user image.
The current refrigerator user image may be acquired by an image capturing device configured in the refrigerator, for example: when a refrigerator user is in front of the refrigerator, the current refrigerator user image is acquired through the image acquisition equipment.
Of course, in some embodiments, the food material recommendation management process may be performed after the set triggering condition is met, for example: just can carry out edible material recommendation management process after refrigerator door body is opened, perhaps, when receiving the disappearance nutrient element management instruction that the terminal point sent, just can start edible material recommendation management process etc. other triggering process just do not exemplify. Therefore, the food material recommendation management process is carried out only when the set triggering condition is met, and the occupation of resources can be reduced.
Step 102: and determining the taken food information corresponding to the current refrigerator user image through image recognition.
The method comprises the steps of acquiring a current refrigerator user image, and therefore, adopting image recognition to recognize corresponding current face information. In some embodiments, face recognition can be performed on a current refrigerator user image to obtain current face information; and determining the taken-out food material information corresponding to the current face information according to the corresponding relation between the stored face information and the taken-out food material information.
The refrigerator stores the corresponding relation between the human face information and the taken food material information. One, two or more refrigerator users can all save the identification information and the taken food material information in the set time into the refrigerator, and the face can distinguish the refrigerator users, namely the face information can be the identification information, so that when the refrigerator users take out food materials from the refrigerator each time, the corresponding relation between the face information and the taken food material information can be configured and saved, namely the food materials can be taken out by the terminal users for image recognition, and the taken food material information is obtained, wherein the food material information comprises: one, two or more kinds of type information, quantity information, weight information, volume information, and the like. Furthermore, the corresponding relation between the human face information and the taken food material information is configured.
The corresponding relation between the stored face information and the taken-out food material information can be updated, and the corresponding relation between the face information and the taken-out food material information can be modified only when the user takes out the food material from the refrigerator. The refrigerator can store the taken food material information of each user within a quarter, a month, a week or a day, namely, the taken food material information within a set time is stored. Once the refrigerator user takes out the food materials from the refrigerator, the food material information which is out of date and taken out can be deleted according to the time sequence, and the food material information taken out at this time is additionally stored.
There are various ways to obtain the face information of the user, for example: the face information of the user is acquired through image acquisition equipment configured in the refrigerator or is communicated with a corresponding terminal, and the face information of the user is acquired from the terminal. That is, in some embodiments, the terminal may send the acquired or stored face picture to the refrigerator, so that the refrigerator acquires the corresponding face information.
Because the corresponding relation between the face information and the taken-out food material information is stored in the refrigerator, after the face identification is carried out, the taken-out food material information corresponding to the current face information can be determined according to the stored corresponding relation after the current face information corresponding to the current refrigerator user image is obtained, namely the taken-out food material information corresponding to the current refrigerator user image is determined.
Step 103: and under the condition that the nutrient elements of the taken food material information have missing nutrient elements according to the preset nutrient balance condition, warning and reminding of the missing nutrient elements are carried out.
Each food material has corresponding nutrient elements, so that the nutrient elements from which the food material information has been extracted can be determined first.
Table 1 is a food nutrient element comparison table provided in the examples of the present disclosure.
If the taken food material information comprises: millet, spinach and the like, and the corresponding nutrient elements can be determined according to the table 1.
Since a human body wants to maintain a healthy body, a balanced nutrient intake is essential, and thus, a nutrient balance condition may be preset, and in some embodiments, the type of nutrient elements necessary for the human body and the corresponding minimum intake may be determined as the preset nutrient balance condition.
Thus, after the nutritional elements of the taken food material information are determined, by referring to the preset nutrition balance condition, if certain nutritional element information is lacked in the taken food material information or the minimum intake amount corresponding to the nutritional element in the preset nutrition balance condition is determined by the number corresponding to the certain nutritional element in the taken food material information, the nutritional element can be determined as a missing nutritional element, and the missing nutritional element can be determined in the nutritional elements of the taken food material information according to the preset nutrition balance condition.
Figure BDA0002118800030000051
TABLE 1
For example, when the end user extracts cereals from the food material information and other vegetables or fruits with relatively low iron content, it is determined that the nutrient elements of the extracted food material information have iron element deficiency, that is, the iron element is a deficiency nutrient element.
The types of food materials are various, and the corresponding nutrient elements of each type are different, so that the corresponding relation between the food material information and the food material nutrient elements can be stored locally, or can be stored in a server in order to save resources. Similarly, the predetermined nutrient balance condition may be stored locally or, alternatively, stored in a server.
Therefore, in some embodiments, the taken food material information is sent to the server, so that the server determines the nutrient elements of the taken food material information, and determines that the nutrient elements are missing according to the stored preset nutrient balance condition; and then, receiving the missing nutrient elements returned by the server.
In some embodiments, the retrieved food material information is sent to the server, such that the server determines the nutritional elements of the retrieved food material information. And then receiving the nutrient elements returned by the server, and determining that the nutrient elements have missing nutrient elements according to the stored preset nutrient balance conditions.
Of course, with the development of artificial intelligence and big data technology, the corresponding relationship between the food material information and the food material nutrient elements stored in the refrigerator or the server can be updated in time.
And the refrigerator needs to warn and remind missing nutrient elements after determining that the missing nutrient elements exist in the nutrient elements according to preset nutrient balance conditions. The way of warning and reminding can be various, for example: graphic and text warning, graphic and sound warning, remote warning and the like. Thus, alerting to the absence of a nutrient element comprises at least one of: carrying out image-text warning reminding of missing nutrient elements on a display interface; carrying out voice warning reminding of missing nutrient elements through a voice playing device; and sending reminding information of missing nutrient elements to the terminal. For example: according to the preset nutrition balance condition, the fact that iron elements are missing in the taken food material information matched with the current terminal user is determined, and therefore 'you are in a nutrient element iron missing state' can be displayed on a display screen of a refrigerator, and meanwhile voice playing can be conducted.
Therefore, in the embodiment of the disclosure, the taken-out food material information matched with the refrigerator user can be determined through face recognition, so that when the missing nutritional elements existing in the nutritional elements of the taken-out food material information are determined according to the preset nutritional balance condition, warning reminding is performed, the probability of unbalanced nutrition of the user is reduced, personalized recommendation and management of food materials are realized, the intelligence of the refrigerator is further improved, the probability of damage to the body of the user due to unbalanced nutrition is also reduced, and the user experience is improved.
Certainly, in the embodiment of the present disclosure, in the process of food material recommendation management, not only the warning prompt of missing nutrient elements is performed, but also the recommendation of food materials can be performed, that is, after the warning prompt of missing nutrient elements is performed, the method further includes: under the condition that the door body of the refrigerator is opened, determining a first food material matched with the missing nutrient elements in the stored food materials; recommending the food material information of the first food material.
When a refrigerator user needs to use food materials in the refrigerator, the door body of the refrigerator needs to be started, so that the process of recommending the food materials is triggered when the door body of the refrigerator is opened, and therefore the occupation of an internal memory can be reduced. In the related art, the method for determining that the door of the refrigerator is opened may be applied, for example, an angle sensor is configured on the door, and when the angle of the door obtained by the angle sensor is greater than a set value, it may be determined that the door of the refrigerator is opened.
The door body of the refrigerator is opened, missing nutrient elements existing in the nutrient elements of the taken food material information are also determined, and at the moment, a first food material matched with the missing nutrient elements in the stored food materials is determined; then, the food material information of the first food material is recommended.
Of course, in some embodiments of the present disclosure, the taken-out food material information corresponding to the current refrigerator user image may also be determined through image recognition under the condition that it is determined that the door body of the refrigerator is opened; under the condition that the nutrient elements of the taken food material information are determined to have missing nutrient elements according to a preset nutrient balance condition, warning reminding of the missing nutrient elements is carried out, and a first food material matched with the missing nutrient elements in the stored food materials is determined; and recommending the food material information of the first food material.
For example, when a refrigerator user opens a refrigerator door, the current refrigerator user image is acquired through an image acquisition device in the refrigerator, so that the corresponding taken-out food material information is determined; then, under the condition that the nutrient element iron is lost in the nutrient elements of the taken food material information is determined according to the preset nutrient balance condition, not only is the voice warning reminding of the nutrient element iron loss performed, but also celery, pork liver and the like matched with the nutrient element iron in the stored food material are determined, and the voice playing ' suggestion that people eat celery and pork liver in a refrigerator ' is performed '.
Therefore, in the embodiment of the disclosure, the recommendation of the food material matched with the missing nutrient elements can be performed, the probability of unbalanced nutrition of the user is further reduced, the personalized recommendation management of the food material is perfected, and the intelligence of the refrigerator is further improved.
Of course, when the first food material is taken out, the food material information of the first food material needs to be recorded in the taken-out food material information, that is, in the case that the first food material is determined to be taken out, the food material information of the first food material is recorded in the taken-out food material information. The accuracy of the nutrient elements is further improved, and therefore the accuracy of food material recommendation management is also improved.
The following sets of operation flows to specific embodiments to illustrate the food material recommendation management process provided by the embodiments of the present invention.
In this embodiment, the refrigerator stores the corresponding relationship between the face information and the taken-out food material information, that is, the user image information can be acquired through the camera configured in the refrigerator, face recognition is performed to obtain corresponding face information, and food material information of the food material taken out by the corresponding refrigerator user at each time is recognized and recorded, so that the corresponding relationship between the face information and the taken-out food material information is configured and stored. In addition, the refrigerator can also locally store the corresponding relation between the food material information and the food material nutrient elements and preset nutrient balance conditions.
Fig. 2 is a flowchart illustrating a food material recommendation management method according to an embodiment of the disclosure. As shown in fig. 2, the process of food material recommendation management includes:
step 201: and acquiring a current refrigerator user image, and performing face recognition to obtain current face information.
No matter whether the current refrigerator user opens the refrigerator or not, as long as the current refrigerator user is within the set range of the refrigerator, the camera arranged in the refrigerator can acquire the current refrigerator user image.
Step 202: and determining the taken-out food material information corresponding to the current face information according to the corresponding relation between the stored face information and the taken-out food material information.
Step 203: and determining the nutrient elements of the taken food material information according to the corresponding relation between the stored food material information and the food material nutrient elements.
Step 204: according to the preset nutrition balance condition, judging whether the nutrient elements have deficiency nutrient elements? If so, go to step 205, otherwise, the process ends.
Step 205: and carrying out image-text warning and reminding of the missing nutrient elements on the display interface, and carrying out warning and reminding of the missing nutrient elements through a voice playing device.
Step 206: is it judged whether the refrigerator door is started? If yes, go to step 207, otherwise, the process ends.
Step 207: determining a first food material matched with the missing nutrient elements in the stored food materials; and performing image-text recommendation on the food material information of the first food material on a display interface.
Therefore, in the embodiment, the taken-out food material information matched with the refrigerator user can be determined through face recognition, and therefore when missing nutritional elements existing in the nutritional elements of the taken-out food material information can be determined according to the preset nutritional balance condition, warning reminding is carried out, the probability of unbalanced nutrition of the user is reduced, personalized recommendation and management of food materials are realized, the intelligence of the refrigerator is further improved, the probability of damage to the body of the user due to unbalanced nutrition is also reduced, and the user experience is improved. In addition, the refrigerator can locally determine the missing nutrient elements, so that the determination speed is increased, and the efficiency of food material recommendation management is further improved.
The following sets of operation flows to specific embodiments to illustrate the food material recommendation management process provided by the embodiments of the present disclosure.
In this embodiment, the refrigerator stores the corresponding relationship between the face information and the food material information taken out, that is, the refrigerator can communicate with the terminal to obtain a user photo, perform face recognition to obtain corresponding face information, and recognize and record the food material information of the food material taken out by the corresponding refrigerator user each time, so that the corresponding relationship between the face information and the body health information is configured and stored. The server stores the corresponding relation between the food material information and the food material nutrient elements and presets nutrient balance conditions.
Fig. 3 is a flowchart illustrating a food material recommendation management method according to an embodiment of the disclosure. As shown in fig. 3, the process of food material recommendation management includes:
step 301: is the door of the refrigerator judged to be opened? If yes, go to step 302, otherwise, go back to step 301.
Step 302: and acquiring a current refrigerator user image, and performing face recognition to obtain current face information.
When a user of the refrigerator opens the refrigerator, a camera arranged in the refrigerator can acquire the image of the user of the refrigerator.
Step 303: and determining the taken-out food material information corresponding to the current face information according to the corresponding relation between the stored face information and the taken-out food material information.
Step 304: and sending the taken food material information to a server.
Step 305: determine if missing nutrient elements returned by the server are received? If so, go to step 306, otherwise, the process ends.
The server stores the corresponding relation between the food material information and the food material nutrient elements and preset nutrient balance conditions. Therefore, the server may determine the food material nutrient elements corresponding to the taken food material information, and then determine whether there are missing nutrient elements in the nutrient elements according to the preset nutrient balance condition? If yes, returning the deficient nutrient elements to the refrigerator.
Step 306: determining a first food material in the stored food materials that matches the missing nutrient elements.
Step 307: the voice playing device is used for warning and reminding missing of the nutrient elements and recommending and reminding the first food material.
For example: "you are now in a missing state of nutrient iron and are advised to eat spinach and pork liver in the refrigerator" through voice playing.
Step 308: is the first food material taken out judged? If so, go to step 309, otherwise, the process ends.
Acquiring an image of the taken-out food material, comparing the image with the first food material after image recognition, determining that the first food material is taken out if the image is matched with the first food material, and executing step 309.
Step 309: recording the food material information of the first food material in the taken-out food material information.
Therefore, in the embodiment, the taken-out food material information matched with the refrigerator user can be determined through face recognition, so that when missing nutritional elements existing in the nutritional elements of the taken-out food material information can be determined according to preset nutritional balance conditions, warning reminding is performed, the probability of unbalanced nutrition of the user is reduced, personalized recommendation and management of food materials are realized, the intelligence of the refrigerator is further improved, the probability of damage to the body of the user due to unbalanced nutrition is also reduced, the user experience is improved, the missing nutritional elements can be determined through the server of the refrigerator, in this way, the storage space is saved, the corresponding relation between the food material information and the food material nutritional elements is stored in the server, updating can be performed in time, and the accuracy of the food material recommendation and management is further improved. The corresponding relation between the face information stored in the refrigerator and the taken-out food material information can be updated along with the taking-out of the first food material, so that the accuracy of the nutrient elements is further improved, and the accuracy of food material recommendation management is further improved.
According to the process of the food material recommendation management, a food material recommendation management device can be constructed.
Fig. 4 is a schematic structural diagram of a food material recommendation management apparatus provided in an embodiment of the present disclosure. As shown in fig. 4, the food material physical examination management apparatus includes: an image acquisition module 410, an information determination module 420, and an alert management module 430.
An image acquisition module 410 configured to acquire a current refrigerator user image.
And an information determining module 420 configured to determine the extracted food material information corresponding to the current refrigerator user image through image recognition.
The warning management module 430 is configured to perform warning reminding of missing nutritional elements when it is determined that the missing nutritional elements exist in the nutritional elements of the food material information taken out according to a preset nutritional balance condition.
In some embodiments, further comprising: a recommendation management module configured to determine a first food material matching the missing nutrient element among the stored food materials in a case where it is determined that the door body of the refrigerator is opened; recommending the food material information of the first food material.
In some embodiments, further comprising: and the configuration storage module is configured to record the food material information of the first food material in the taken food material information under the condition that the first food material is determined to be taken out.
In some embodiments, the alert management module 430 is specifically configured to send the extracted food material information to the server, so that the server determines nutritional elements of the extracted food material information, determines missing nutritional elements in the nutritional elements according to the stored preset nutritional balance condition, and receives the missing nutritional elements returned by the server.
In some embodiments, the alert management module 430 is specifically configured to perform the food material alert reminding by using at least one of the following methods: carrying out image-text warning and reminding of the lack of the nutrient elements on a display interface; carrying out voice warning reminding of missing nutrient elements through a voice playing device; and sending reminding information of missing nutrient elements to the terminal.
The following illustrates a food material recommendation management process performed by the food material recommendation management apparatus according to the embodiment of the present disclosure.
Fig. 5 is a schematic structural diagram of a food material recommendation management apparatus according to an embodiment of the present disclosure. As shown in fig. 5, the food material physical examination management apparatus includes: the image obtaining module 410, the information determining module 420, and the alert management module 430 may further include a configuration updating module 440 and a recommendation management module 450, and the alert management module 430 may include: a teletext voice prompt unit 431.
The configuration updating module 440 can obtain the user photos through communication with the terminal, perform face recognition to obtain corresponding face information, and recognize and record food material information of food materials taken out by corresponding refrigerator users each time, thereby configuring and storing a corresponding relationship between the face information and the body health information.
In this way, the image obtaining module 410 may obtain the current image of the user of the refrigerator when it is determined that the door of the refrigerator is opened. The information determining module 420 can perform face recognition on the current refrigerator user image to obtain current face information; and according to the corresponding relationship between the face information stored in the configuration updating module 440 and the extracted food material information, the extracted food material information corresponding to the current face information is determined.
The warning management module 430 may send the taken-out food material information to the server, so that the server may determine food material nutrient elements corresponding to the taken-out food material information according to the correspondence between the stored food material information and the food material nutrient elements, and then determine whether there are missing nutrient elements in the nutrient elements according to a preset nutrient balance condition? If yes, returning the deficient nutrient elements to the refrigerator. Thus, after receiving the missing nutrient elements returned by the server, the image-text voice prompt unit 431 in the warning management module 430 can perform image-text warning and reminding of the missing nutrient elements on the display interface, and perform warning and reminding of the missing nutrient elements through the voice playing device.
In addition, the recommendation management module 450 may further determine a first food material matched with the missing nutrient element in the stored food materials, and similarly, may also perform recommendation reminding of the first food material through the display interface and the voice playing device.
In the case that it is determined that the first food material is taken out, the configuration updating module 440 can record the food material information of the first food material in the taken-out food material information.
Therefore, in the embodiment, the food material recommendation management device can determine the taken food material information matched with the refrigerator user through face recognition, so that when the missing nutritional elements existing in the nutritional elements of the taken food material information are determined according to the preset nutritional balance condition, warning reminding is performed, the probability of unbalanced nutrition of the user is reduced, personalized recommendation management of food materials is realized, the intelligence of the refrigerator is further improved, the probability of damage to the body of the user due to unbalanced nutrition is also reduced, the user experience is improved, and the missing nutritional elements can be determined through the server, so that the storage space is saved, the corresponding relation between the food material information and the food material nutritional elements is stored in the server, timely updating can be performed, and the accuracy of food material recommendation management is further improved. The corresponding relation between the stored face information and the taken-out food material information can be updated along with the taking-out of the first food material, so that the accuracy of the nutrient elements is further improved, and the accuracy of food material recommendation management is further improved.
An embodiment of the present disclosure provides a food material recommendation management device, a structure of which is shown in fig. 6, including:
a processor (processor)100 and a memory (memory)101, and may further include a Communication Interface (Communication Interface)102 and a bus 103. The processor 100, the communication interface 102, and the memory 101 may communicate with each other via a bus 103. The communication interface 102 may be used for information transfer. The processor 100 may call the logic instructions in the memory 101 to execute the method for food material recommendation management of the above embodiment.
In addition, the logic instructions in the memory 101 may be implemented in the form of software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products.
The memory 101, which is a computer-readable storage medium, may be used for storing software programs, computer-executable programs, such as program instructions/modules corresponding to the methods in the embodiments of the present disclosure. The processor 100 executes the functional application and data processing by executing the program instructions/modules stored in the memory 101, so as to implement the method for food material recommendation management in the above method embodiment.
The memory 101 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal device, and the like. In addition, memory 101 may include high speed random access memory, and may also include non-volatile memory.
The embodiment of the disclosure provides a refrigerator comprising the food material recommendation management device.
The embodiment of the disclosure provides a computer-readable storage medium, which stores computer-executable instructions configured to execute the food material recommendation management method.
An embodiment of the present disclosure provides a computer program product, where the computer program product includes a computer program stored on a computer-readable storage medium, where the computer program includes program instructions, and when the program instructions are executed by a computer, the computer is caused to execute the food material recommendation management method.
The computer-readable storage medium described above may be a transitory computer-readable storage medium or a non-transitory computer-readable storage medium.
The technical solution of the embodiments of the present disclosure may be embodied in the form of a software product, where the computer software product is stored in a storage medium and includes one or more instructions to enable a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method of the embodiments of the present disclosure. And the aforementioned storage medium may be a non-transitory storage medium comprising: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and may also be transient storage media.
The above description and drawings sufficiently illustrate embodiments of the disclosure to enable those skilled in the art to practice them. Other embodiments may incorporate structural, logical, electrical, process, and other changes. The examples merely typify possible variations. Individual components and functions are optional unless explicitly required, and the sequence of operations may vary. Portions and features of some embodiments may be included in or substituted for those of others. The scope of the embodiments of the present disclosure includes the full ambit of the claims, as well as all available equivalents of the claims. As used in this application, although the terms "first," "second," etc. may be used in this application to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without changing the meaning of the description, so long as all occurrences of the "first element" are renamed consistently and all occurrences of the "second element" are renamed consistently. The first and second elements are both elements, but may not be the same element. Furthermore, the words used in the specification are words of description only and are not intended to limit the claims. As used in the description of the embodiments and the claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Similarly, the term "and/or" as used in this application is meant to encompass any and all possible combinations of one or more of the associated listed. Furthermore, the terms "comprises" and/or "comprising," when used in this application, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. Without further limitation, an element defined by the phrase "comprising an …" does not exclude the presence of other like elements in a process, method or apparatus that comprises the element. In this document, each embodiment may be described with emphasis on differences from other embodiments, and the same and similar parts between the respective embodiments may be referred to each other. For methods, products, etc. of the embodiment disclosures, reference may be made to the description of the method section for relevance if it corresponds to the method section of the embodiment disclosure.
Those of skill in the art would appreciate that the elements and algorithm steps of the various embodiments described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software may depend upon the particular application and design constraints imposed on the technical solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments. It can be clearly understood by the skilled person that, for convenience and brevity of description, the specific working processes of the system, the apparatus and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments disclosed herein, the disclosed methods, products (including but not limited to devices, apparatuses, etc.) may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units may be merely a logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form. The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to implement the present embodiment. In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. In the description corresponding to the flowcharts and block diagrams in the figures, operations or steps corresponding to different blocks may also occur in different orders than disclosed in the description, and sometimes there is no particular order between different operations or steps. For example, two sequential operations or steps may in fact be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. Each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Claims (10)

1. A method for recommending and managing food materials is characterized by comprising the following steps:
acquiring a current refrigerator user image;
determining the taken food material information corresponding to the current refrigerator user image through image identification;
and under the condition that the nutrient elements of the taken food material information have missing nutrient elements according to a preset nutrient balance condition, warning and reminding of the missing nutrient elements are carried out.
2. The method according to claim 1, wherein after the warning of the missing nutrient element is performed, the method further comprises:
under the condition that the door body of the refrigerator is opened, determining a first food material matched with the missing nutrient elements in the stored food materials;
recommending the food material information of the first food material.
3. The method of claim 2, further comprising:
in the event that it is determined that the first food material is taken out, recording food material information of the first food material in the taken-out food material information.
4. The method of claim 1, wherein the warning reminding of the missing nutrient element when determining that the missing nutrient element exists in the nutrient elements of the extracted food material information comprises:
sending the taken food material information to a server, so that the server determines nutrient elements of the taken food material information, and determines that the nutrient elements are missing according to a stored preset nutrient balance condition;
and receiving the missing nutrient elements returned by the server.
5. The method of claim 1, wherein the alerting of the missing nutrient element comprises at least one of:
carrying out image-text warning reminding of the missing nutrient elements on a display interface;
carrying out voice warning reminding of the missing nutrient elements through a voice playing device;
and sending reminding information of missing the nutritional elements to a terminal.
6. An apparatus for recommending and managing food materials, comprising:
the image acquisition module is configured to acquire a current refrigerator user image;
the information determining module is configured to determine the taken food material information corresponding to the current refrigerator user image through image recognition;
and the warning management module is configured to perform warning reminding of the missing nutrient elements under the condition that the missing nutrient elements exist in the nutrient elements of the taken food material information according to a preset nutrient balance condition.
7. The apparatus of claim 6, further comprising:
the recommendation management module is configured to determine a first food material matched with the missing nutrient elements in the stored food materials under the condition that the door body of the refrigerator is determined to be opened; recommending the food material information of the first food material.
8. The apparatus of claim 7, further comprising:
a configuration saving module configured to record the food material information of the first food material in the taken-out food material information in the case that the first food material is determined to be taken out.
9. The apparatus of claim 7,
the warning management module is specifically configured to send the taken food material information to a server, so that the server determines nutrient elements of the taken food material information, determines missing nutrient elements in the nutrient elements according to a stored preset nutrient balance condition, and receives the missing nutrient elements returned by the server.
10. A refrigerator characterized by comprising a device according to any one of claims 6 to 9.
CN201910599479.8A 2019-07-04 2019-07-04 Food material recommendation management method and device and refrigerator Pending CN112185510A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910599479.8A CN112185510A (en) 2019-07-04 2019-07-04 Food material recommendation management method and device and refrigerator

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910599479.8A CN112185510A (en) 2019-07-04 2019-07-04 Food material recommendation management method and device and refrigerator

Publications (1)

Publication Number Publication Date
CN112185510A true CN112185510A (en) 2021-01-05

Family

ID=73915072

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910599479.8A Pending CN112185510A (en) 2019-07-04 2019-07-04 Food material recommendation management method and device and refrigerator

Country Status (1)

Country Link
CN (1) CN112185510A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113409915A (en) * 2021-05-10 2021-09-17 王蕴秋 Safety recommendation system capable of preventing food from deteriorating and working method thereof

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8924239B1 (en) * 2007-10-10 2014-12-30 Maureen Kay Kurple Method and apparatus for monitoring calorie, nutrient, and expense of food consumption and effect on long term health and short term state
CN104361041A (en) * 2014-10-28 2015-02-18 华南理工大学 Auxiliary method and auxiliary system of intelligent refrigerator
CN105509394A (en) * 2015-05-05 2016-04-20 万军 Refrigerator
CN106339576A (en) * 2016-07-20 2017-01-18 美的集团股份有限公司 Health management method and system
CN106372138A (en) * 2016-08-26 2017-02-01 乐视控股(北京)有限公司 Information processing method and apparatus
CN107238427A (en) * 2017-07-17 2017-10-10 上海镭慎光电科技有限公司 Intelligent nutrition scale system and the method that diet suggestion is provided
CN107341350A (en) * 2017-07-05 2017-11-10 百度在线网络技术(北京)有限公司 Food materials intelligent management and device, server, intelligent refrigerator, storage medium
WO2018023286A1 (en) * 2016-07-31 2018-02-08 赵晓丽 Information push method when recommending diet and refrigerator
CN107731278A (en) * 2017-09-04 2018-02-23 广东数相智能科技有限公司 A kind of food recognition methods, nutrient health analysis method, system and device
CN108036563A (en) * 2017-11-15 2018-05-15 惠州高盛达科技有限公司 A kind of intelligent refrigerator system of achievable interaction
CN109166614A (en) * 2018-08-14 2019-01-08 四川虹美智能科技有限公司 A kind of system and method for recommending personal health menu
CN109697601A (en) * 2018-12-26 2019-04-30 杭州蒙蒙科技有限公司 A kind of processing method and processing device of prompting message

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8924239B1 (en) * 2007-10-10 2014-12-30 Maureen Kay Kurple Method and apparatus for monitoring calorie, nutrient, and expense of food consumption and effect on long term health and short term state
CN104361041A (en) * 2014-10-28 2015-02-18 华南理工大学 Auxiliary method and auxiliary system of intelligent refrigerator
CN105509394A (en) * 2015-05-05 2016-04-20 万军 Refrigerator
CN106339576A (en) * 2016-07-20 2017-01-18 美的集团股份有限公司 Health management method and system
WO2018023286A1 (en) * 2016-07-31 2018-02-08 赵晓丽 Information push method when recommending diet and refrigerator
CN106372138A (en) * 2016-08-26 2017-02-01 乐视控股(北京)有限公司 Information processing method and apparatus
CN107341350A (en) * 2017-07-05 2017-11-10 百度在线网络技术(北京)有限公司 Food materials intelligent management and device, server, intelligent refrigerator, storage medium
CN107238427A (en) * 2017-07-17 2017-10-10 上海镭慎光电科技有限公司 Intelligent nutrition scale system and the method that diet suggestion is provided
CN107731278A (en) * 2017-09-04 2018-02-23 广东数相智能科技有限公司 A kind of food recognition methods, nutrient health analysis method, system and device
CN108036563A (en) * 2017-11-15 2018-05-15 惠州高盛达科技有限公司 A kind of intelligent refrigerator system of achievable interaction
CN109166614A (en) * 2018-08-14 2019-01-08 四川虹美智能科技有限公司 A kind of system and method for recommending personal health menu
CN109697601A (en) * 2018-12-26 2019-04-30 杭州蒙蒙科技有限公司 A kind of processing method and processing device of prompting message

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113409915A (en) * 2021-05-10 2021-09-17 王蕴秋 Safety recommendation system capable of preventing food from deteriorating and working method thereof

Similar Documents

Publication Publication Date Title
CN106871567B (en) Food recommendation processing method and device based on intelligent refrigerator and intelligent refrigerator
CN105844445B (en) Information providing method, server, and information providing system
US8811755B2 (en) Detecting recurring events in consumer image collections
CN109829108B (en) Information recommendation method and device, electronic equipment and readable storage medium
AU2018370069A1 (en) Meal service management system and operating method therefor
CN104537057B (en) Data search method and client
EP2570981A1 (en) Content output device, content output method, content output program, and recording medium with content output program thereupon
EP1560130A3 (en) Image retrieval system and image retrieval method
CN109492152B (en) Method, device, computer equipment and storage medium for pushing custom content
US20160070960A1 (en) Image processing apparatus
WO2016101766A1 (en) Method and device for obtaining similar face images and face image information
CN104408553A (en) Health weight-reducing management system and management method thereof
CN111159452A (en) Method and system for reminding forgetful article, computer equipment and storage medium
CN111190682B (en) Reminding item display method and device
CN112185510A (en) Food material recommendation management method and device and refrigerator
CN112185511A (en) Food material recommendation management method and device and refrigerator
CN110263528A (en) Removal repeats method, apparatus, equipment and the storage medium of account
CN114372160A (en) Search request processing method and device, computer equipment and storage medium
CN107562954B (en) Recommendation search method and device based on mobile terminal and mobile terminal
JP2006114011A (en) Information providing method and apparatus
CN110966838A (en) Food refrigeration information monitoring method and device, electronic equipment and storage medium
CN114897574A (en) Food material commodity information recommendation method and device and electronic equipment
US20180165770A1 (en) Providing targeted content
CN115329128A (en) Data processing method and device suitable for nutrition management system
US20090278939A1 (en) Quality monitoring system and method for expirable objects

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210105

RJ01 Rejection of invention patent application after publication