CN114322443A - Refrigerator food detection prompt system - Google Patents
Refrigerator food detection prompt system Download PDFInfo
- Publication number
- CN114322443A CN114322443A CN202111547598.2A CN202111547598A CN114322443A CN 114322443 A CN114322443 A CN 114322443A CN 202111547598 A CN202111547598 A CN 202111547598A CN 114322443 A CN114322443 A CN 114322443A
- Authority
- CN
- China
- Prior art keywords
- food
- refrigerator
- information
- image
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
The invention discloses a refrigerator food detection prompt system, which comprises: the image acquisition module is arranged in the refrigerator and used for acquiring images of food in the refrigerator; the image analysis module comprises a category identification unit, a form identification unit and a position identification unit, wherein the category identification unit identifies the food category in the image, the form identification unit identifies the food form in the image, and the position identification unit identifies the food position in the refrigerator; the prompt information management module comprises a prompt information generation unit and an information display control unit, wherein the prompt information generation unit generates state prompt information associated with corresponding food according to the food form, and the information display control unit displays the state prompt information in an area associated with the food position on the display module; and the display module is arranged on the door and/or the box body of the refrigerator. The invention can more intuitively and effectively display the related prompt information, and the user can quickly determine the position of the related food in the refrigerator, so that the refrigerator is more intelligent.
Description
Technical Field
The invention belongs to the technical field of intelligent household appliances, and particularly relates to a refrigerator food detection prompting system.
Background
The refrigerator is used as a common household appliance and is used for storing various foods, but the foods are not eaten in time after being placed for too long time, so that the foods are deteriorated, and a user needs to open the refrigerator for multiple times to confirm whether the foods are deteriorated, so that the refrigerator is very inconvenient, and therefore the refrigerator needs to be provided with equipment capable of automatically detecting whether the foods in the refrigerator are deteriorated in time and then feeding the equipment back to the user to remind the user of eating.
At present, some intelligent refrigerators have functions of food detection and prompt, but the functions are not visual and effective enough no matter prompt information is sent to an intelligent terminal connected with the refrigerator or the prompt information is displayed on a conventional display screen of the refrigerator.
Disclosure of Invention
The invention provides a refrigerator food detection prompt system which can detect the state of food in a refrigerator in time and visually and effectively display related prompt information. The invention is realized by the following technical scheme:
a refrigerator food detection reminder system comprising:
the image acquisition module is arranged in the refrigerator and used for acquiring images of food in the refrigerator;
image analysis module includes: a category identification unit that identifies a food category in the image; a form recognition unit for recognizing the form of the food in the image;
the prompt message management module comprises: a prompt message generating unit for generating a state prompt message associated with the corresponding food according to the food form;
the display module is arranged on the door and/or the box body of the refrigerator and is used for displaying information;
it is characterized in that the image analysis module further comprises: a position recognition unit recognizing a position of food in the refrigerator; the prompt message management module further comprises: and the information display control unit is used for displaying the state prompt information in an area which is associated with the food position on the display module.
Specifically, the area on the display module associated with the food position is at least two prompt information display partitions corresponding to at least two storage areas in the refrigerator, and the information display control unit displays the state prompt information in the prompt information display partition corresponding to the storage area where the corresponding food is located in the refrigerator.
Specifically, the position recognition unit recognizes the position of food in the refrigerator by recognizing the identity of the image acquisition module corresponding to the storage interval, or by recognizing the position of food in the image, or by recognizing the identity of the image acquisition module corresponding to the storage interval and recognizing the position of food in the image in a matching manner.
Specifically, the display module is a transparent display screen arranged on a door of the refrigerator, and the transparent display screen is provided with a prompt information display partition corresponding to a storage grid in the refrigerator.
Preferably, the refrigerator food detection prompting system further comprises a gas detection module and a gas analysis module, wherein the gas detection module detects characteristic gas in the refrigerator, and the gas analysis module judges the odor state in the refrigerator according to the detected characteristic gas; the prompting information generating unit is also used for generating smell prompting information according to the smell state; the display module is provided with a smell information display partition for displaying the smell prompt information; and the information display control unit displays the smell prompt information on the smell information display subarea on the display module.
Preferably, the prompt information management module further comprises a user instruction receiving unit for receiving the description information about the food to be prompted autonomously in the refrigerator, which is edited by the user; the prompt information generating unit further generates autonomous prompt information associated with corresponding food according to the description information; the information display control unit displays the self-prompting information in an area which is associated with the food position needing self-prompting on the display module.
Specifically, the description information is received from an information input module of the refrigerator or an intelligent mobile terminal in communication connection with the refrigerator.
Preferably, the prompt information management module further comprises a recommended menu generating unit, which judges the priority eating level of the food in the refrigerator according to the food form of the food in the refrigerator, and generates a recommended menu; the prompt information generating unit is also used for generating menu prompt information according to the recommended menu; and the information display control unit displays the menu prompt information on the display module.
Specifically, the category identification unit compares the currently acquired image with a pre-stored food standard image, and identifies the food category by comparing at least one factor of the overall contour and the overall color of the food; the shape recognition unit compares the currently collected image with a pre-stored food standard image, and recognizes whether the food in the image is deteriorated or not by analyzing and judging at least one factor of the whole outline, the whole color and the local color change of the food.
Specifically, the status prompt information includes picture information and eating suggestion information of the corresponding food.
The invention has the beneficial effects that: the state of food in the refrigerator is detected to generate corresponding prompt information, and the state prompt information corresponding to the food is displayed in an area, associated with the position of the food, of the display module according to the position of the food in the refrigerator. The invention can more intuitively and effectively display the related prompt information, and the user can quickly determine the position of the related food in the refrigerator, so that the refrigerator is more intelligent. In addition, the invention also provides a prompt function based on undetected refrigerator. Moreover, the invention also provides a function of judging the priority eating grade of the food in the refrigerator based on the food form in the refrigerator, generating and prompting the recommended menu.
Drawings
Fig. 1 is a schematic diagram of a refrigerator food detection prompting system according to an embodiment of the invention.
Fig. 2 is a flow chart of detecting and prompting food in the refrigerator according to the embodiment of the invention.
Fig. 3 is an exemplary diagram of displaying an eggplant image and a text reminder at a position corresponding to an eggplant on a transparent display screen in the embodiment of the present invention.
Fig. 4 is a flowchart of generating a recipe according to the form of food in the refrigerator according to an embodiment of the present invention.
Fig. 5 is a schematic diagram illustrating a menu displayed in a prompt manner according to an embodiment of the present invention.
Fig. 6 is a flowchart of an autonomous prompt message generated according to food stored in a refrigerator according to an embodiment of the present invention.
Fig. 7 is a schematic diagram illustrating an autonomous prompting message according to an embodiment of the present invention.
Detailed Description
Referring to fig. 1, the food detection prompting system for a refrigerator provided in this embodiment includes an image acquisition module, an image analysis module, a prompting information management module, and a display module. The image analysis module comprises a category identification unit and a form identification unit; the prompt information management module comprises a prompt information generation unit, an information display control unit, a user indication receiving unit and a recommended menu generation unit. The following describes the functions and relationships of the above modules and units:
the technical personnel in the field know that a plurality of storage sections are arranged in the refrigerator, for example, the storage sections are divided by storage grids in the refrigerator, and even a certain storage grid is further divided in front and back and left and right. An important aspect of the present embodiment is to detect and indicate the food stored in a specific storage area.
Referring to fig. 2, the image capturing module is disposed inside the refrigerator for capturing images of food in the refrigerator, the image capturing module may be a plurality of cameras 10 (see fig. 3, 5, and 7) respectively disposed in a plurality of storage sections of the refrigerator for capturing images of the storage sections, and the plurality of cameras may be disposed at multiple angles. Of course, it is not excluded that only one camera 10 is provided, and in general, the configuration of the camera is sufficient to enable the detection of the view angle of only one camera to cover at least two detected storage sections in the refrigerator.
The image analysis module is used for identifying food in the currently acquired image, analyzing and judging the morphological state of the food in the image, wherein the morphological state comprises the situations of no deterioration, going to deteriorate, being deteriorated and the like; the image analysis module can be an image analysis processing module integrated in a refrigerator processor. The category identification unit is used for identifying food categories in the image; the shape recognition unit is used for recognizing the food shape in the image. Specifically, the position identification unit identifies the position of the food in the refrigerator by identifying the identity of the image acquisition module corresponding to the storage section (i.e., which camera acquires the corresponding image), or by identifying the position of the food in the image (i.e., positioning the coordinate position of the food in the image), or by identifying the identity of the image acquisition module corresponding to the storage section and recognizing the position of the food in the image in a matching manner.
In this embodiment, the category identification unit compares the currently acquired image with a pre-stored standard food image, and identifies the food category by comparing at least one factor of the overall contour and the overall color of the food; the form recognition unit compares the currently collected image with a pre-stored food standard image, and recognizes the food form whether the food in the image is deteriorated or not through analyzing and judging at least one factor of the whole outline, the whole color and the local color change of the food. For example, eggplants in the currently acquired image are compared with a prestored standard image of the eggplants, and if all situations such as color difference, poor surface smoothness, sporadic variation points and the like are found, the food form of the eggplants is identified as deterioration; if it is found that only color differences are present, while the surface is still smooth and there are no sporadic variation points, the food morphology of the eggplant is identified as about to deteriorate; if no color difference, poor surface smoothness, sporadic variation points, etc. are present, the food form of the eggplant is recognized as normal (not deteriorated).
A prompt message generating unit of the prompt message management module generates state prompt messages related to corresponding food according to the food forms; the state prompt information comprises picture information and edible suggestion information of corresponding food, and the edible suggestion information specifically comprises reminding information of eating or not and suggestion information of an edible period. And an information display control unit of the prompt information management module displays the state prompt information in an area which is associated with the food position on the display module.
In this embodiment, the display module is disposed on a door and/or a body of the refrigerator, and is specifically a transparent display screen disposed on the door of the refrigerator, the transparent display screen has prompt information display partitions corresponding to all storage grids in the refrigerator, and the state prompt information is displayed in the prompt information display partitions corresponding to the storage partitions where corresponding food is located in the refrigerator. For example, as shown in fig. 3, if it is detected that the eggplants in the refrigerator are about to deteriorate, the corresponding positions of the eggplants on the transparent screen display the images of the eggplants and the text reminders. In this embodiment, all the status prompt messages may also be sent to the handheld intelligent terminal of the user at the same time, as shown in fig. 1 and fig. 2.
With reference to fig. 1, 4 and 5, the recommended recipe generating unit of the prompt information management module is configured to determine, according to the food form of the food in the refrigerator, a priority eating level of the food in the refrigerator, and generate a recommended recipe; the prompt information generating unit is also used for generating menu prompt information according to the recommended menu; and the information display control unit displays the menu prompt information on a transparent display screen. For example, if a fish in the refrigerator is identified as about to deteriorate, the fish is judged to be of priority utility, and a menu recommending the relevant fish (such as a boiled fish or other popular menu) is displayed on the display module. As a preferred scheme, the transparent display screen has a touch interaction function and can be used as an information input module of the refrigerator, and after a user clicks and confirms a menu of the boiled fish, the cooking step of the boiled fish is further called and displayed.
As shown in fig. 1, the user instruction receiving unit of the reminder information management module is used for receiving the description information about the food needing to be reminded autonomously in the refrigerator, which is edited by the user; the prompt information generating unit further generates autonomous prompt information associated with corresponding food according to the description information; the information display control unit displays the self-prompting information in an area which is associated with the food position needing self-prompting on the display module. For example, with reference to fig. 6 and 7, a user may put a meal made by a help partner or a parent into a refrigerator in advance, receive description information input by the user through a refrigerator information input module (e.g., a transparent display screen with a touch function or other information input modules on the refrigerator), and display a reminder label and a message at a position corresponding to a position of food in the refrigerator on the transparent screen of the refrigerator. In addition, the description information may also be received from an intelligent mobile terminal communicatively connected to the refrigerator.
Referring to fig. 1, the gas detection module and the gas analysis module are combined, and the gas detection module detects characteristic gas of food in the refrigerator, such as a gas sensor 20 (see fig. 3, 5, and 7) for detecting putrefactive gas components such as carbon dioxide, acetaldehyde, pentanediamine, hydrogen sulfide, mercaptan, thioether, and ammonia. The gas analysis module judges the odor state in the refrigerator according to the detected food characteristic gas; the prompt information management module also generates smell prompt information according to the smell state; the display module is provided with a smell information display partition for displaying the smell information; and the information display control unit displays the smell prompt information on the smell information display subarea on the display module.
The foregoing detailed description is given for clearness of disclosure and not of limitation, and all changes that come within the meaning and range of equivalents thereof are intended to be embraced therein without undue experimentation.
Claims (10)
1. A refrigerator food detection reminder system comprising:
the image acquisition module is arranged in the refrigerator and used for acquiring images of food in the refrigerator;
image analysis module includes: a category identification unit that identifies a food category in the image; a form recognition unit for recognizing the form of the food in the image;
the prompt message management module comprises: a prompt message generating unit for generating a state prompt message associated with the corresponding food according to the food form;
the display module is arranged on the door and/or the box body of the refrigerator and is used for displaying information;
it is characterized in that the image analysis module further comprises: a position recognition unit recognizing a position of food in the refrigerator; the prompt message management module further comprises: and the information display control unit is used for displaying the state prompt information in an area which is associated with the food position on the display module.
2. The system for detecting and prompting food in a refrigerator according to claim 1, wherein the areas of the display module associated with the food positions are at least two prompt information display partitions corresponding to at least two storage areas in the refrigerator, and the information display control unit displays the status prompt information in the prompt information display partition corresponding to the storage area in the refrigerator where the corresponding food is located.
3. The refrigerator food detection prompt system of claim 2, wherein the position identification unit identifies the position of food in the refrigerator by identifying the identity of the image acquisition module corresponding to the storage region, or by identifying the position of food in the image, or by identifying the identity of the image acquisition module corresponding to the storage region and cooperatively identifying the position of food in the image.
4. The food detection and prompting system for the refrigerator as claimed in claim 2, wherein the display module is a transparent display screen disposed on a door of the refrigerator, and the transparent display screen has a prompt information display partition corresponding to a storage grid in the refrigerator.
5. The food detection prompting system for the refrigerator as claimed in claim 1, further comprising a gas detection module and a gas analysis module, wherein the gas detection module detects the characteristic gas in the refrigerator, and the gas analysis module judges the odor state in the refrigerator according to the detected characteristic gas; the prompting information generating unit is also used for generating smell prompting information according to the smell state; the display module is provided with a smell information display partition for displaying the smell prompt information; and the information display control unit displays the smell prompt information on the smell information display subarea on the display module.
6. The food detection prompting system for the refrigerator according to claim 1, wherein the prompting information management module further comprises a user instruction receiving unit for receiving description information about the food to be prompted autonomously in the refrigerator, which is edited by the user; the prompt information generating unit further generates autonomous prompt information associated with corresponding food according to the description information; the information display control unit displays the self-prompting information in an area which is associated with the food position needing self-prompting on the display module.
7. The system of claim 1, wherein the description information is received from an information input module of the refrigerator or an intelligent mobile terminal communicatively connected to the refrigerator.
8. The system for detecting and prompting food in a refrigerator according to claim 1, wherein the prompting information management module further comprises a recommended menu generating unit for generating a recommended menu by judging the priority eating level of the food in the refrigerator according to the food shape of the food in the refrigerator; the prompt information generating unit is also used for generating menu prompt information according to the recommended menu; and the information display control unit displays the menu prompt information on the display module.
9. The method for prompting food detection of a refrigerator according to claim 5, wherein the category identification unit compares the currently collected image with a pre-stored standard image of the food, and identifies the food category by comparing at least one factor of an overall contour and an overall color of the food; the shape recognition unit compares the currently collected image with a pre-stored food standard image, and recognizes whether the food in the image is deteriorated or not by analyzing and judging at least one factor of the whole outline, the whole color and the local color change of the food.
10. The refrigerator food detection prompting method of claim 5, wherein the prompting message comprises picture information and eating suggestion information of the corresponding food.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111547598.2A CN114322443A (en) | 2021-12-16 | 2021-12-16 | Refrigerator food detection prompt system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111547598.2A CN114322443A (en) | 2021-12-16 | 2021-12-16 | Refrigerator food detection prompt system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114322443A true CN114322443A (en) | 2022-04-12 |
Family
ID=81053317
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111547598.2A Pending CN114322443A (en) | 2021-12-16 | 2021-12-16 | Refrigerator food detection prompt system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114322443A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100901037B1 (en) * | 2007-12-27 | 2009-06-04 | 엘지전자 주식회사 | Refrigerator |
| CN107763958A (en) * | 2017-09-27 | 2018-03-06 | 珠海格力电器股份有限公司 | A kind of intelligent refrigerator |
| CN208983699U (en) * | 2018-11-07 | 2019-06-14 | 珠海格力电器股份有限公司 | A kind of refrigerator monitoring dietary regimen |
| CN110895082A (en) * | 2019-11-15 | 2020-03-20 | 珠海格力电器股份有限公司 | Refrigerator control method and device, computer readable storage medium and refrigerator |
| CN111043830A (en) * | 2019-12-23 | 2020-04-21 | 四川虹美智能科技有限公司 | Refrigerator and method for detecting deterioration condition of food in refrigerator |
| CN111310586A (en) * | 2020-01-19 | 2020-06-19 | 合肥美的电冰箱有限公司 | Management method and management device for food in refrigerator and refrigerator |
-
2021
- 2021-12-16 CN CN202111547598.2A patent/CN114322443A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100901037B1 (en) * | 2007-12-27 | 2009-06-04 | 엘지전자 주식회사 | Refrigerator |
| CN107763958A (en) * | 2017-09-27 | 2018-03-06 | 珠海格力电器股份有限公司 | A kind of intelligent refrigerator |
| CN208983699U (en) * | 2018-11-07 | 2019-06-14 | 珠海格力电器股份有限公司 | A kind of refrigerator monitoring dietary regimen |
| CN110895082A (en) * | 2019-11-15 | 2020-03-20 | 珠海格力电器股份有限公司 | Refrigerator control method and device, computer readable storage medium and refrigerator |
| CN111043830A (en) * | 2019-12-23 | 2020-04-21 | 四川虹美智能科技有限公司 | Refrigerator and method for detecting deterioration condition of food in refrigerator |
| CN111310586A (en) * | 2020-01-19 | 2020-06-19 | 合肥美的电冰箱有限公司 | Management method and management device for food in refrigerator and refrigerator |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107468048B (en) | Cooking appliance and control method thereof | |
| US20200349328A1 (en) | Wireless device and selective user control and management of a wireless device and data | |
| CN103884152B (en) | Refrigerator and the system of health index are provided | |
| US20190253270A1 (en) | Remote state following devices | |
| US11680744B2 (en) | Artificial intelligence refrigerator | |
| JP2017533481A (en) | Information generation method, information generation apparatus, computer program, and computer-readable storage medium | |
| US11506448B2 (en) | Method and device for managing food in refrigerator | |
| CN111568153A (en) | Kitchen electrical system for realizing dish cooking procedure recommendation | |
| CN104197632A (en) | Intelligent temperature regulating refrigerator | |
| US11954626B2 (en) | Refrigerator and method for displaying user interface on refrigerator, user terminal, and method for performing function in user terminal | |
| CN204115391U (en) | A kind of intelligent thermoregulating refrigerator | |
| CN107763958A (en) | A kind of intelligent refrigerator | |
| CN105718854B (en) | Remote food material management system | |
| CN108679922B (en) | Refrigerator control method based on smart home and smart refrigerator | |
| US20170284733A1 (en) | Remote food management system | |
| CN108224896A (en) | Refrigerator management equipment, system, refrigerator and mobile terminal | |
| US10995960B2 (en) | Food preparation entity | |
| EP4209733A1 (en) | Food detection device | |
| CN109542053A (en) | A kind of control method of smart kitchen systems and smart kitchen systems | |
| CN111568242A (en) | Water dispenser control method, water dispenser and computer readable storage medium | |
| Shweta | Intelligent refrigerator using artificial intelligence | |
| CN114322443A (en) | Refrigerator food detection prompt system | |
| CN108955068B (en) | Food material management method and food material management system for refrigerator for blind people | |
| CN108170058A (en) | Control method, system and the medium of intelligent electric cooker | |
| CN110731686A (en) | Control method and system applied to electric cooker |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220412 |