CN116026097A

CN116026097A - Intelligent refrigerator reminding method and device, intelligent refrigerator and storage medium

Info

Publication number: CN116026097A
Application number: CN202211742418.0A
Authority: CN
Inventors: 徐城; 刘诗敏
Original assignee: Gree Electric Appliances Inc of Zhuhai
Current assignee: Gree Electric Appliances Inc of Zhuhai
Priority date: 2022-12-29
Filing date: 2022-12-29
Publication date: 2023-04-28

Abstract

The embodiment of the invention relates to an intelligent refrigerator reminding method and device, an intelligent refrigerator and a storage medium, wherein the method comprises the following steps: acquiring article information and a position to be stored of articles to be stored in the intelligent refrigerator; acquiring article information of stored articles associated with the to-be-stored position; determining the deterioration information of the article to be stored according to the article information of the article to be stored, and determining the deterioration information of the article to be stored according to the article information of the article to be stored; judging whether the deterioration information of the article to be stored is consistent with the deterioration information of the stored article or not; and reminding the article to be stored if the deterioration information of the article to be stored is inconsistent with the deterioration information of the stored article. Therefore, the storage device can realize the technical effects of pre-reminding placed articles, reminding users to store the articles with larger deterioration time difference separately, reducing the influence of the articles easy to deteriorate on the articles difficult to deteriorate and prolonging the preservation time of the articles.

Description

Intelligent refrigerator reminding method and device, intelligent refrigerator and storage medium

Technical Field

The embodiment of the invention relates to the technical field of intelligent home, in particular to an intelligent refrigerator reminding method and device, an intelligent refrigerator and a storage medium.

Background

Under the same preservation environment, the spoilage curves of different food materials are different, for example, when the apples are preserved in a refrigerator in a refrigerating way, the apples can be stored for a plurality of weeks and can be kept unchanged, and melon fruits such as melons and the like can be kept unchanged for a plurality of days. If these food materials are put together when stored in a refrigerator, the spoiled substances in the spoiled food materials easily affect the food materials that are not easily spoiled, so that the spoiled food materials that are not easily spoiled are accelerated.

Therefore, how to solve the influence of the easily spoiled food on the food which is not easily spoiled and reduce the preservation time of the food becomes a current urgent problem to be solved.

Disclosure of Invention

In view of this, in order to solve the above-mentioned problem that the easy-to-deteriorate food material affects the difficult-to-deteriorate food material, the fresh-keeping time of the food material is reduced, the embodiment of the invention provides a reminding method and device of an intelligent refrigerator, an intelligent refrigerator and a storage medium.

In a first aspect, an embodiment of the present invention provides an intelligent refrigerator reminding method, including:

acquiring article information and a position to be stored of articles to be stored in the intelligent refrigerator;

Acquiring article information of stored articles associated with the to-be-stored position;

determining the deterioration information of the article to be stored according to the article information of the article to be stored, and determining the deterioration information of the article to be stored according to the article information of the article to be stored;

judging whether the deterioration information of the article to be stored is consistent with the deterioration information of the stored article or not;

and reminding the article to be stored if the deterioration information of the article to be stored is inconsistent with the deterioration information of the stored article.

In one possible implementation manner, the acquiring the article information and the position to be stored of the articles in the intelligent refrigerator includes:

when a new article to be stored is detected to be added in the intelligent refrigerator, determining a position to be stored according to a moving 5 track of the article to be stored;

and determining article information of the article to be stored according to the acquired appearance image of the article to be stored.

In one possible embodiment, the acquiring the item information of the stored item associated with the location to be stored includes:

acquiring an item image of an item associated with the location to be stored;

0 obtaining an item attribute of the item according to the item image, wherein the item attribute comprises an item class

Other, item freshness characteristic information, packaging information, and/or item parameters;

and taking the acquired object attribute as object information of the stored object.

In one possible embodiment, the determining the item according to the item information of the item to be stored

The method for determining the metamorphic information of the stored article according to the metamorphic information of the stored article comprises the following steps:

judging whether the article information contains article parameters or not;

and when the article information contains article parameters, taking the article parameters as the deterioration information.

In one possible embodiment, when the item information includes an item parameter, the method includes

The article parameter as the deterioration information includes: 0, acquiring article packaging information and an article packaging type in the article information;

determining the parameter type of the item parameter;

and respectively generating deterioration information of the to-be-stored article and the stored article according to the article packaging type and the parameter type.

In one possible embodiment, the method further comprises: 5, when the article information does not contain the article parameters, sending the article packaging information to a server;

And receiving the metamorphic information of the article to be stored and the metamorphic information of the stored article fed back by the server.

In one possible embodiment, the determining the deterioration information of the article to be stored according to the article information of the article to be stored, and determining the deterioration information of the article to be stored according to the article information of the article to be stored, includes:

acquiring a deterioration curve corresponding to the article category according to the article category of the article information and the article freshness characteristic information;

and determining the spoilage time of the article to be stored according to the spoilage curve and the article freshness characteristic information, and determining the spoilage time of the stored article.

In one possible embodiment, the determining whether the deterioration information of the object to be stored is consistent with the deterioration information of the stored object includes:

judging whether the fitting degree of the articles between the deterioration curve of the articles to be stored and the deterioration curve of the stored articles meets a preset fitting range or not according to the deterioration curve;

when the fitting degree of the articles meets the fitting range, determining that the deterioration information of the articles to be stored is consistent with that of the stored articles;

And when the fitting degree of the articles does not meet the fitting range, determining that the deterioration information of the articles to be stored and the stored articles is inconsistent.

In one possible embodiment, the method further comprises:

judging whether a first time difference corresponding to a peak value of the deterioration curve of the article to be stored and the stored article accords with a preset range or not according to the deterioration curve;

when the first time difference meets the preset range, determining that the deterioration information of the article to be stored is consistent with that of the stored article;

and when the first time difference does not meet the preset range, determining that the deterioration information of the article to be stored is inconsistent with that of the stored article.

In one possible embodiment, the method further comprises:

judging whether a second time difference of the deterioration time of the article to be stored and the stored article meets a preset range or not according to the deterioration time;

when the second time difference meets the preset range, determining that the deterioration information of the article to be stored is consistent with that of the stored article;

and when the second time difference does not meet the preset range, determining that the deterioration information of the object to be stored is inconsistent with that of the stored object.

In one possible implementation manner, the reminding the to-be-stored article if the deterioration information of the to-be-stored article is inconsistent with the deterioration information of the stored article includes:

generating reminding information of the transfer position of the article to be stored;

and displaying the target position information of the object to be stored.

In one possible embodiment, the method further comprises:

detecting whether the storage position of the article to be stored is changed or not within a set time;

and when detecting that the storage position of the article to be stored is not changed, executing the step of reminding the article to be stored again.

In one possible embodiment, the method further comprises:

judging whether the deterioration information of the article to be stored and the deterioration information of the stored article exceed a deterioration threshold value or not;

when the deterioration information of the article to be stored is smaller than the deterioration threshold value, displaying a prompt for timely use of the article to be stored;

and when the deterioration information of the stored article is smaller than the deterioration threshold value, displaying a prompt for timely use of the stored article.

In a second aspect, an embodiment of the present invention provides an intelligent refrigerator reminding method, including:

The acquisition module is used for acquiring article information and positions to be stored of articles to be stored in the intelligent refrigerator;

the acquisition module is further used for acquiring article information of the stored articles associated with the to-be-stored positions;

the determining module is used for determining the metamorphic information of the article to be stored according to the article information of the article to be stored and determining the metamorphic information of the article to be stored according to the article information of the article to be stored;

the judging module is used for judging whether the deterioration information of the article to be stored is consistent with the deterioration information of the stored article or not;

and the reminding module is used for reminding the articles to be stored if the deterioration information of the articles to be stored is inconsistent with the deterioration information of the stored articles.

In a third aspect, an embodiment of the present invention provides an intelligent refrigerator, including: the intelligent refrigerator reminding method comprises a processor and a memory, wherein the processor is used for executing an intelligent refrigerator reminding program stored in the memory so as to realize the intelligent refrigerator reminding method in any one of the first aspect.

In a fourth aspect, an embodiment of the present invention provides a storage medium storing one or more programs, where the one or more programs are executable by one or more processors to implement the intelligent refrigerator reminding method according to any one of the first aspects.

According to the intelligent refrigerator reminding scheme provided by the embodiment of the invention, the article information of the articles to be stored and the positions to be stored are obtained, the article information of the articles stored relative to the periphery of the positions to be stored is obtained, the metamorphic information of the articles to be stored is obtained, the similarity of the metamorphic information of the articles to be stored is judged, the difference of the metamorphic degree of the articles to be stored is determined, and when the metamorphic information of the articles to be stored is inconsistent, the difference of the metamorphic information of the articles to be stored is larger; according to the scheme, the placed articles can be pre-reminded, the users are reminded to store the articles with larger deterioration time difference separately, the influence of the articles easy to deteriorate on the articles difficult to deteriorate is reduced, and the technical effect of the preservation time of the articles is prolonged.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

Fig. 1 is a schematic flow chart of an intelligent refrigerator reminding method according to an embodiment of the invention;

fig. 2 is a flow chart of another intelligent refrigerator reminding method according to an embodiment of the invention;

fig. 3 is a flow chart of another reminding method of an intelligent refrigerator according to an embodiment of the invention;

FIG. 4 is a schematic diagram of a deterioration fit of a storage article according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a deterioration curve of a storage article according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of an intelligent refrigerator reminding device according to an embodiment of the present invention;

fig. 7 is a schematic structural diagram of an intelligent refrigerator according to an embodiment of the present invention.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

The terms "comprising" and "having" in embodiments of the present invention are used to mean including open and mean that there may be additional elements/components/etc. in addition to the listed elements/components/etc.; the terms "first" and "second" and the like are used merely as labels, and are not intended to limit the number of their objects. Furthermore, the various elements and regions in the figures are only schematically illustrated and thus the present invention is not limited to the dimensions or distances illustrated in the figures.

For the purpose of facilitating an understanding of the embodiments of the present invention, reference will now be made to the following description of specific embodiments, taken in conjunction with the accompanying drawings, which are not intended to limit the embodiments of the invention.

Fig. 1 is a flow chart of a reminding method of an intelligent refrigerator according to an embodiment of the invention. The execution main body of the intelligent refrigerator is an intelligent refrigerator. Referring to the diagram provided in fig. 1, the intelligent refrigerator reminding method specifically includes:

s101, acquiring article information and a position to be stored of articles to be stored in the intelligent refrigerator.

The execution main body of the embodiment of the invention is an intelligent refrigerator, and an information acquisition device is arranged on the intelligent refrigerator and is used for acquiring the shape, package information or appearance color information of an article placed in the intelligent refrigerator. Through detecting when having new article to put into intelligent refrigerator, judge reasonable storage position according to the rotten condition of article, under the unreasonable circumstances of depositing, remind the user to change current storage position to reasonable position, can realize reminding in advance the article of placing, separately store the article that the rotten time phase difference is great through reminding the user, reduce the influence of easy rotten article to difficult rotten article, the technical effect of the fresh-keeping time of extension article.

The article to be stored is herein understood to be a stored article placed in a smart refrigerator. The articles to be stored can be vegetables, fruits, seasonings or wine and other foods put into the intelligent refrigerator. Article information as referred to herein may be understood as information characterizing features of the article, such as: with information such as the date of manufacture of the package, the color of the appearance of the article, or the moisture content of the article. The storage location is understood to be the location information detected when the article is randomly placed in the intelligent refrigerator.

Further, when the intelligent refrigerator works normally, a pre-reminding function of the article storage position is started. When the fact that the articles to be stored are randomly placed in the intelligent refrigerator is detected, the article detailed information and the corresponding random storage positions of the articles to be stored are obtained through image detection, and the article information and the data information corresponding to the positions to be stored are uploaded to a server to prepare for next analysis.

S102, acquiring article information of the stored articles associated with the to-be-stored positions.

The association as referred to herein is understood to be adjacent sides, may be adjacent surrounding locations, or for the same floor, same grid, or same box area within the intelligent refrigerator. Stored items are understood herein to be items that have been assigned a reasonable storage location relative to the first time they were stored. The article information is understood to mean article information of stored articles acquired in advance.

Further, the stored articles around the position where the articles to be stored are located are determined through a device arranged in the intelligent refrigerator, and article information corresponding to the stored articles is collected.

S103, determining the deterioration information of the to-be-stored article according to the article information of the to-be-stored article, and determining the deterioration information of the stored article according to the article information of the stored article.

The spoilage information is understood to be characteristic information representing the inedibility of spoilage of the article, such as the degree of bad smell caused by decay, expiration time, spoilage curve, degree of decay of appearance or freshness.

Further, the deterioration speed and the freshness of the current article are known by referring to the article information of the article to be stored, the deterioration degree of the article to be stored is determined, and similarly, the deterioration degree of the article to be stored is determined according to the deterioration speed and the freshness contained in the article information of the article to be stored, so that preparation is made for next determination of the storage position of the article to be stored.

S104, judging whether the deterioration information of the article to be stored is consistent with the deterioration information of the stored article.

The term "consistency" as used herein is understood to mean the degree of similarity, which may be in the form of a similarity or difference, between the degree of deterioration of the stored item and the stored item.

Further, the obtained metamorphic information of the articles to be stored and the metamorphic information of the stored articles are judged, the similarity of the metamorphic information and the metamorphic information is determined, and whether the storage position of the articles to be stored is correct or not is further determined.

S105, reminding the articles to be stored if the deterioration information of the articles to be stored is inconsistent with the deterioration information of the stored articles.

The reminding can be understood as reminding the user directly through the intelligent refrigerator, and the recommended storage position of the substance to be stored can be sent to a server or an application terminal through the intelligent refrigerator for display.

Further, when it is detected that the deterioration information of the article to be stored is far from the deterioration information of the stored article, it is determined that the deterioration information of the two are inconsistent. And judging that the storage position of the current article to be stored is unreasonable, and influencing the deterioration speed of surrounding articles. The message for reminding the transfer position is directly displayed through the intelligent refrigerator in the form of voice or flashing lamps, so that the user is reminded that the storage position of the current articles to be stored is unreasonable. The storage position of the recommended articles to be stored can be displayed by sending the detection result to a server or a control terminal. The technical effects of realizing the pre-reminding when storing the articles, reminding the user to store the articles with larger deterioration time difference separately, reducing the influence of the articles easy to deteriorate on the articles difficult to deteriorate and prolonging the preservation time of the articles are achieved.

According to the intelligent refrigerator reminding method provided by the embodiment of the invention, the article information and the position to be stored of the articles to be stored are obtained, the article information of the articles stored relative to the periphery of the position to be stored is obtained, the metamorphic information of the articles to be stored is obtained, the similarity of the metamorphic information of the articles to be stored is judged, the difference of the metamorphic degree of the articles to be stored is determined, when the metamorphic information of the articles to be stored is inconsistent, the articles to be stored are reminded when the metamorphic information difference of the articles to be stored is large, the user is reminded to pre-remind the articles to be stored, the articles with large metamorphic time differences are reminded to be stored separately, the influence of the articles easy to be spoiled on the articles which are difficult to be spoiled is reduced, and the technical effect of the freshness keeping time of the articles is prolonged.

Fig. 2 is a flow chart of another intelligent refrigerator reminding method according to an embodiment of the invention. Fig. 2 is presented on the basis of the above embodiment. According to the diagram of fig. 2, the intelligent refrigerator reminding method specifically further comprises the following steps:

s201, when it is detected that a new article to be stored is added in the intelligent refrigerator, determining a position to be stored according to a moving track of the article to be stored.

The execution main body of the embodiment of the invention is an intelligent refrigerator, and an information acquisition device is arranged on the intelligent refrigerator and used for acquiring the shape of an article placed in the intelligent refrigerator, the odor concentration released by the article, packaging information or appearance color information. Through detecting when having new article to put into intelligent refrigerator, judge whether current storage position is reasonable according to the rotten condition of article, under the unreasonable circumstances of depositing, remind the user to change current storage position and give the reasonable position of recommendation, can realize reminding in advance the article of placing, separately store the article that the rotten time phase difference is great through reminding the user, reduce the influence of easy rotten article to difficult rotten article, the technical effect of the fresh-keeping time of extension article.

The article to be stored is understood as the corresponding stored article when the article is placed in the intelligent refrigerator. The articles to be stored can be vegetables, fruits, seasonings or wine and other foods put into the intelligent refrigerator. The storage position is understood to be the specific position information of storage detected when the article is randomly placed into the intelligent refrigerator for the first time. The moving track is understood to be a moving line before the object to be stored is placed at the position to be stored in the intelligent refrigerator through an image acquisition device (such as an infrared detection device) arranged in the intelligent refrigerator.

Further, when the intelligent refrigerator works normally, a pre-reminding function of the article storage position is started. When the fact that the articles to be stored are randomly placed in the intelligent refrigerator is detected, the storage track of the articles to be stored is obtained through image detection, and then the random storage position corresponding to the articles to be stored is determined.

S202, determining article information of the article to be stored according to the acquired appearance image of the article to be stored.

Article information as referred to herein may be understood as information characterizing features of the article, such as: with information such as the date of manufacture of the package, the color of the appearance of the article, or the moisture content of the article. Alternatively, the odor concentration released by the article may also be detected as article information by an odor sensor.

Further, an image acquisition device is arranged on the intelligent refrigerator, and the package information of the articles to be stored, the freshness of the articles or the appearance color of the articles and other article information are obtained by acquiring the outer images of the articles to be stored 5 at the position to be stored.

S203, acquiring an article image of an article associated with the position to be stored.

An item as referred to herein may be understood as a stored item or other item to be stored adjacent to a location to be stored.

0, further, after the position to be stored is obtained through an image acquisition device in the intelligent refrigerator, the method comprises the steps of

The appearance images of the articles are acquired by the articles corresponding to the adjacent positions (the same layer, the same lattice and the adjacent positions in the same box).

S204, acquiring the object attribute of the object according to the object image, wherein the object attribute comprises object category, object freshness characteristic information, package information and/or object parameters.

An item attribute as referred to herein may be understood as a parameter that characterizes an item. The item category 5 is understood herein to mean foods such as fruits, vegetables, meats, eggs, milk, spices, or wine stored in a smart refrigerator

Species. The freshness characteristic information of the article can be understood as freshness, color and dryness of the leaves of vegetables or fruits; the degree of redness of the meat surface. The package information is understood to mean information about date of manufacture and shelf life of the outer package such as a seasoning. The article parameters described herein can be understood as

And 0 change data from the process of putting into the intelligent refrigerator to the process of rotting and deteriorating are stored in advance for each food material in the server. Such as the spoilage profile of fruit.

Further, an image acquisition device in the intelligent refrigerator is used for acquiring an article image of the stored article, and determining the attribute of the article according to attribute information corresponding to the article image so as to prepare for determining deterioration information of the stored article in the next step.

S205, taking the acquired object attribute as object information of the stored object.

5 further, obtaining the shelf life of the stored article by obtaining the article attribute of the stored article

In the case, the item attribute is set as item information of the stored item.

In one possible example scenario, a tomato is placed in a smart refrigerator. And collecting the storage position of the tomatoes through an image sensor in the intelligent refrigerator. Food material information of other food materials in the same-layer environment around the tomatoes is detected through the infrared sensor, wherein the food material information comprises food material names, types, freshness and shelf life.

S206, determining the deterioration information of the to-be-stored article according to the article information of the to-be-stored article, and determining the deterioration information of the stored article according to the article information of the stored article.

Further, the deterioration speed and the freshness of the current article are known by referring to the article information of the article to be stored, the deterioration degree of the article to be stored is determined, and similarly, the deterioration degree of the article to be stored is determined according to the article information of the stored article adjacent to the position to be stored including the deterioration speed and the freshness, so that preparation is made for next judgment of the storage position of the article to be stored.

S207, judging whether the deterioration information of the article to be stored is consistent with the deterioration information of the stored article.

Further, the obtained metamorphic information of the articles to be stored and the metamorphic information of the stored articles are judged, the similarity of the metamorphic information and the metamorphic information is determined, and whether the storage position of the articles to be stored is reasonable or not is further determined.

S208, reminding the articles to be stored if the deterioration information of the articles to be stored is inconsistent with the deterioration information of the stored articles.

The reminding can be understood as reminding the user directly through the intelligent refrigerator, and reminding the user of the name or image information of the specific food material needing to be changed in the storage position or reminding the user of the specific position corresponding to the food material needing to be changed in the storage position and the food material in conflict with the storage position; the recommended storage position of the substance to be stored can be sent to a server or an application terminal for display through the intelligent refrigerator.

Further, when it is detected that the deterioration information of the article to be stored is far from the deterioration information of the stored article, it is determined that the deterioration information of the two are inconsistent. And judging that the storage position of the current article to be stored is unreasonable, and influencing the deterioration speed of surrounding articles. The intelligent refrigerator directly displays the message for reminding the transfer position by utilizing the form of voice, image or flashing lamp, and reminds the user that the storage position of the current article to be stored is unreasonable. The storage position of the recommended articles to be stored can be displayed by sending the detection result to a server or a control terminal. The technical effects of realizing the pre-reminding when storing the articles, reminding the user to store the articles with larger deterioration time difference separately, reducing the influence of the articles easy to deteriorate on the articles difficult to deteriorate and prolonging the preservation time of the articles are achieved.

In a possible example scene, the tomatoes which are just placed are detected to be in a fresh state, but the leaves of the spinach which are placed around the tomatoes are detected to be in a state of going to deteriorate, the deterioration time difference value of the deterioration information of the tomatoes and the spinach is obtained by comparing the deterioration time of the two vegetables, the fact that the storage positions of the current tomatoes do not conform to the same type of storage principle is determined, a reminding message for changing the storage positions of the tomatoes is generated, the reminding message can be sent to a mobile phone of a user, the storage positions of the tomatoes are reminded to not conform to requirements on a visual interface corresponding to application software on the mobile phone, the recommended positions are displayed above the interface of the application software of the mobile phone, the storage positions for changing the tomatoes are reminded, and the storage time of the tomatoes is prevented from being influenced by the deterioration of the spinach.

S209, generating reminding information of the transfer position of the article to be stored.

The transition location is understood herein to mean the operation of changing the current storage location.

Further, when the deterioration information of the stored article is inconsistent with the deterioration information of the stored article, the storage position of the food material to be stored is determined to be unreasonable, and the position of the food material to be stored needs to be adjusted. Generating a reminding message to remind a user to operate aiming at changing the storage position.

S210, displaying target position information of the object to be stored.

The display can be understood as directly displaying the reminding through the intelligent refrigerator, or sending the reminding message to a server or an intelligent terminal (mobile phone and control application software) through the intelligent refrigerator for reminding. The target location is understood herein to be a specified location that is a satisfactory recommendation for the item to be stored.

Further, after generating a reminding message for changing the current storage position of the article to be stored, displaying the reminding message for recommending the target position of the article to be stored through equipment such as a voice function, a visual interface or a flashing lamp on the intelligent refrigerator; or the recommended reminding message is sent to the server or the medium-energy terminal equipment through the intelligent refrigerator, and the reminding message for recommending the target position of the object to be stored is displayed on the server or the intelligent terminal.

S211, detecting whether the storage position of the article to be stored is changed or not in the set time.

The set time is herein understood to be a period detection time set after the alert message of the item to be stored is generated.

Further, after the reminding message for reminding the user of changing the storage position of the article to be stored is generated, the intelligent refrigerator periodically detects the storage position of the article to be stored after the intelligent refrigerator does not detect that the user changes the storage position of the article to be stored within a set time, and judges whether the storage position of the article to be stored is changed or not, so that the user is convenient to notice or hear the first message reminding.

And S212, when detecting that the storage position of the article to be stored is not changed, executing the step of reminding the article to be stored again.

Further, when the storage position of the article to be stored is periodically detected to be unchanged, a prompt of the article to be stored is sent through the intelligent refrigerator, or a prompt message is sent to a server or terminal equipment through the intelligent refrigerator again, and the user is prompted to change the storage position of the article to be stored as soon as possible.

S213, judging whether the deterioration information of the article to be stored and the deterioration information of the stored article exceed a deterioration threshold value.

The deterioration threshold is understood here to mean the shelf life or the optimal consumption time of the item.

Further, when detecting that the deterioration information of the article to be stored is consistent with the deterioration information of the stored article, judging that the storage position of the current article to be stored meets the requirement. Further, it is judged whether or not the item to be stored and/or stored items adjacent to the substance to be stored have exceeded a deterioration threshold (optimal eating time).

And S214, displaying prompt for timely use of the to-be-stored object when the deterioration information of the to-be-stored object is smaller than the deterioration threshold value.

Further, when the optimal eating time of the food material to be stored is detected to be smaller than the deterioration threshold value, the optimal eating time of the current food material to be stored is determined to have elapsed, and a message prompt for quick eating is displayed and used for reminding a user to eat as soon as possible or throw away as soon as possible.

And S215, when the deterioration information of the stored articles is smaller than the deterioration threshold value, displaying a prompt for timely use of the stored articles.

Further, when the optimal eating time of the stored food materials adjacent to the to-be-stored position is detected to be smaller than the deterioration threshold value, the optimal eating time of the stored food materials is determined to be elapsed, and a message prompt for quick eating is displayed for reminding a user to eat the stored food materials as soon as possible or throw away the stored food materials as soon as possible.

According to the intelligent refrigerator reminding method provided by the embodiment of the invention, the article information and the storage position of the articles to be stored and the article information of the stored articles in the adjacent storage positions are detected; and determining deterioration information of the article information and the article information. Judging whether the storage position of the current article to be stored meets the condition according to the difference value of the two pieces of metamorphic information, and generating a reminding message when the metamorphic information of the article to be stored is inconsistent with that of the stored article; further generating a reminding message for changing the target position; comparing the deterioration information of the two with a deterioration threshold value, judging whether the stored articles and/or the stored articles exceed the optimal eating time, and reminding a user to eat in time; the technical effects of realizing the pre-reminding when storing the articles, reminding the user to store the articles with larger deterioration time difference separately, reducing the influence of the articles easy to deteriorate on the articles difficult to deteriorate and prolonging the preservation time of the articles are achieved.

Fig. 3 is a flow chart of another reminding method of an intelligent refrigerator according to an embodiment of the invention. Fig. 3 is presented on the basis of the first embodiment. Referring to the diagram provided in fig. 3, the intelligent refrigerator reminding method specifically further includes:

s301, acquiring article information and a position to be stored of articles to be stored in the intelligent refrigerator.

S302, acquiring article information of the stored articles associated with the to-be-stored positions.

S303, determining the deterioration information of the to-be-stored article according to the article information of the to-be-stored article, and determining the deterioration information of the stored article according to the article information of the stored article.

S304, judging whether the article information contains article parameters.

S305, when the object information contains the object parameters, the object parameters are used as modification information.

The term "item parameter" is understood here to mean information such as a characteristic curve or a shelf life of the item.

Further, after the metamorphic information of the object to be stored and the stored object is obtained, judging whether the object parameter exists in the metamorphic information, and when the object parameter exists in the object information of the object to be stored and the stored object, taking the object parameter of the object to be stored as the metamorphic information of the object to be stored and taking the object parameter of the stored object as the metamorphic information of the stored object.

In one possible real scene, when tomatoes placed in a refrigerator and apples in adjacent positions are detected, the appearance color, the freshness information and the quality guarantee period of the tomatoes are obtained according to the freshness information, the appearance color and the quality guarantee period of the apples acquired by the image acquisition equipment, and the quality guarantee period of the apples and the quality guarantee period of the tomatoes are judged as deterioration characteristics.

S306, acquiring the article packaging information in the article information and the type of the article packaging.

S307, determining the parameter type of the item parameter.

The package information is understood to be specific information of the outer package of the food material, such as bottling, plastic insurance film packaging, etc., and the package type is understood to be the unpacking condition of the outer package of the food material. The parameter types mentioned here can be understood as reference criteria characterizing the deterioration rate of the food material, such as: and information such as a deterioration curve, a maturity change rate and the like of the food materials stored in the database.

Further, after determining the deterioration information of the food material to be stored, the package information and the package type of the two food materials are obtained after determining the deterioration information of the stored food material. And determining the parameter types of the two food materials according to the article parameters (such as the quality guarantee period of the food materials) of the two food materials.

S308, respectively generating deterioration information of the to-be-stored articles and the stored articles according to the article packaging type and the parameter type.

And further generating deterioration information of the articles to be stored and the stored articles containing two data information of the article packaging type and the parameter type according to the article packaging type and the parameter type corresponding to the articles to be stored and the stored articles, and judging whether the storage positions of the articles to be stored and the stored articles meet the requirements or not by utilizing the difference of the article packaging type and the parameter type.

In one possible example scenario, the item information includes item parameters (shelf life), and the shelf life is directly taken as deterioration information; further, the article information includes package information (whether or not to tamper with) and a plurality of expiration dates (tamper-proof expiration dates, not tamper-proof expiration dates), and one expiration date is selected as deterioration information according to the tamper-proof condition. When the quality guarantee period of the food material is used as the deterioration information, the deterioration information of the food material and the food material can be directly compared through the quality guarantee period time on the outer package of the food material, and a corresponding comparison result is obtained.

And S309, when the article information does not contain the article parameters, the article packaging information is sent to the server.

S310, receiving the metamorphic information of the articles to be stored and the metamorphic information of the stored articles fed back by the server.

Further, when detecting that characteristic data of article parameters does not exist in article information of articles to be stored and/or stored articles, sending packaging information of the articles acquired by the images to a cloud server, searching a database of metamorphic characteristic data of corresponding food materials through the cloud server, acquiring metamorphic characteristic data of specified food materials, and sending the metamorphic characteristic data as metamorphic information to the intelligent refrigerator.

In one possible example scenario, when it is detected that one apple is placed, the surrounding adjacently placed food material is detected as a cabbage. By acquiring the outer package information of the two food materials, the information such as the production date or the quality guarantee period and the like on the outer package can be known, at the moment, the images of the apples and the cabbages are sent to the cloud server, the generation curve or the storage time curve for the apples and the cabbages is searched by the cloud server, and the generated curve or the storage time curve is fed back to the intelligent refrigerator as the deterioration characteristics of the apples and the cabbages.

S311, acquiring a deterioration curve corresponding to the object type according to the object type of the object information and the object freshness characteristic information.

The deterioration curve is understood to be the change curve between the freshness and time of each food material. For example, the change in spinach leaf freshness over time. Different food materials have different deterioration curves, and when two similar food materials are in different eating times, the corresponding deterioration curves have the same shape.

Further, according to the object type and the object freshness characteristic information, a change curve of the effective eating time of the object is obtained, and the change curve of the food material can be a change curve of the food material to be stored and/or the stored food material.

S312, determining the deterioration time of the article to be stored according to the deterioration curve and the article freshness characteristic information, and determining the deterioration time of the stored article.

The deterioration time is understood to be the length of time from the current time as the starting point of time to the time when the food material is not edible. The deterioration speed of each food material is different, and each food material corresponds to one deterioration time.

Further, the food material change rule can be obtained according to the food material change curve. And (5) carrying the information into a deterioration curve according to the freshness characteristic information of the current food material to obtain corresponding residual use time, and further obtaining the corresponding deterioration time of the food material.

S313, judging whether the fitting degree of the articles between the deterioration curve of the articles to be stored and the deterioration curve of the stored articles meets a preset fitting range or not according to the deterioration curve.

The fitting degree of the article can be understood as the curve fitting degree of the corresponding deterioration curves of two food materials, and the fitting range can be understood as the similarity condition of the deterioration rules of the set food materials. For example, the spoilage profile of canned food material and the spoilage profile of fresh vegetables differ significantly, and the fitting degree of the spoilage profile results to be large.

Further, according to the metamorphic curve of the object to be stored and the metamorphic curve of the stored object, a fitting result of the metamorphic curves of the two food materials is obtained through a fitting curve processing mode, the fitting result is compared with a reasonable fitting range, and whether the fitting degree of the metamorphic curves of the two food materials meets the requirement or not is judged.

And S314, when the fitting degree of the objects meets the fitting range, determining that the deterioration information of the objects to be stored is consistent with that of the stored objects.

And S315, when the fitting degree of the objects does not meet the fitting range, determining that the deterioration information of the objects to be stored is inconsistent with that of the stored objects.

Further, carrying out object fitting degree calculation according to the deterioration curves of the two food materials to obtain a fitting result, comparing the fitting result with a fitting range, and determining that the similarity of the deterioration curves of the two food materials is high when the object fitting degree meets the fitting range, so that the two food materials can be determined to be the same food material, and can be stored together; when the fitting degree of the objects does not meet the fitting range, the similarity difference of the deterioration curves of the two food materials is determined to be large, and the two food materials can be determined to be different types of food materials, so that the storage position of the current object to be stored is determined to not meet the condition, and the position of the object to be stored needs to be adjusted.

In one possible example scenario, fig. 4 is a schematic diagram of a metamorphic fit of a stored item according to an embodiment of the present invention. Wherein, curve 1 represents the metamorphic curve of spinach, curve 2 represents the metamorphic curve of kiwi fruit, curve 3 represents the metamorphic curve of fermented bean curd, and curve 4 represents the metamorphic curve of oyster sauce. The intelligent refrigerator detects that the spinach is placed in the refrigerator, then the kiwi fruits are detected at adjacent positions, and the fitting degree of the curve 1 and the curve 2 is calculated through analysis, so that the fitting degree result exceeds the set fitting range [ 2 days, 10 days ]. The storage position of the spinach which is placed at present is not reasonable, and the storage position of the spinach is required to be changed. Similarly, according to the fitting degree of the deterioration curve 3 of the fermented bean curd and the deterioration curve 4 of the oyster sauce which are adjacently placed, the fitting degree of the deterioration curve 3 of the fermented bean curd and the deterioration curve 4 of the oyster sauce can be directly determined to be very high, the set requirement is met, and the deterioration curve 3 and the deterioration curve 4 of the oyster sauce can be determined to be stored together.

S316, judging whether a first time difference corresponding to a peak value of the deterioration curve of the object to be stored and the stored object accords with a preset range or not according to the deterioration curve.

The peak of the deterioration curve is understood to mean the highest point of the deterioration curve, which characterizes the optimal eating time of the food material. The first time difference is understood here as the difference in the time abscissas of the peaks of the two deterioration curves. The preset range is the difference between the deterioration time of two stored food materials.

Further, peak value calculation is carried out according to the deterioration curves of the two food materials, the time abscissa corresponding to the peak value of the two food materials is obtained, the difference value of the time abscissa of the two food materials is obtained as a first time difference, and the first time difference is compared with a preset range to judge whether the condition of storage together is met.

And S317, when the first time difference meets the preset range, determining that the deterioration information of the object to be stored is consistent with that of the stored object.

And S318, when the first time difference does not meet the preset range, determining that the deterioration information of the article to be stored is inconsistent with that of the stored article.

Further, when the first time difference meets the preset range, the deterioration time of the two food materials is not greatly determined, the two food materials can be determined to be food materials with the same freshness, and the two food materials can be stored together; when the first time difference is analyzed to not meet the preset range, the fact that the deterioration time of the two food materials is very different is determined, the fact that the two food materials are in different freshness can be determined, the fact that the storage position of the current article to be stored does not meet the condition is determined, and the position of the article to be stored needs to be adjusted so as to prevent the food materials close to the deterioration time from affecting the food materials reaching the deterioration time.

In one possible example scenario, FIG. 5 is a diagram of a spoilage curve of a stored item according to an embodiment of the present invention

Schematic of the line. Wherein, curve 1 represents the metamorphic curve of green apples, curve 2 represents the metamorphic 5-quality curve of red apples, and the green apples are detected by the intelligent refrigerator and then detected at adjacent positions after being put into the refrigerator

If the peak values of the curve 1 and the curve 2 are calculated by analysis, the peak value S1 of the curve 1 and the peak value S2 of the curve 2 are obtained, the deterioration time difference T is obtained according to the difference value of the corresponding abscissa of the peak value S1 and the peak value S2, the deterioration time difference T exceeds the preset range [ 2 days, 5 days ], the currently placed green apples and the currently placed green apples are judged

The deterioration time of the red apples is too great, and the storage position is unreasonable. The storage location of the green apples should be changed. 0S319, judging the second time of deterioration of the stored article and the stored article according to the time of deterioration

Whether the time difference satisfies a preset range.

The second time difference is understood to mean the specific time difference between the two food materials when they are specifically spoiled. The deterioration time is understood here as the length of time that the stored item and the stored item adjacent to the storage location currently begin to deteriorate over time.

And 5S320, when the second time difference meets the preset range, determining that the deterioration information of the object to be stored is consistent with that of the stored object.

S321, when the second time difference does not meet the preset range, determining that the deterioration information of the object to be stored is inconsistent with that of the stored object.

Further, the spoilage time of the two food materials is obtained by detecting the time length of the stored article to be stored, which is the time length of the spoilage 0 when the current time of the article to be stored starts to be expired and the corresponding spoilage time length of the stored article

And (3) difference. The deterioration time difference is compared with a preset range which is set to be placed together. When the deterioration time difference is within a preset range, determining that the current two food materials are close to each other in the deterioration time length, and storing the two food materials together; when the deterioration time difference exceeds the preset range, the current time length of the deterioration of the two food materials is determined to be very different, and the two food materials cannot be stored together and need to be placed separately.

5S322, if the deterioration information of the object to be stored is inconsistent with the deterioration information of the stored object, treating

And storing the article for reminding.

According to the intelligent refrigerator reminding method provided by the embodiment of the invention, the article information and the position to be stored of the article to be stored are obtained, the article information of the article to be stored relative to the articles stored around the position to be stored is obtained, and when the metamorphic information is a metamorphic curve, the similarity of the metamorphic information of the article to be stored is judged according to the fitting degree of the metamorphic curve, the difference of the metamorphic degree of the article to be stored is determined, and when the metamorphic information of the article to be stored is inconsistent, the difference of the metamorphic information of the article to be stored is larger; and judging the deterioration time difference of the deterioration information of the two according to the difference value between the peak values of the deterioration curves, determining the difference of the deterioration degrees of the two, and when the difference of the deterioration time difference of the two is large, indicating that the difference of the deterioration information of the two is large, reminding the articles to be stored, realizing the pre-reminding of the placed articles, reminding users to store the articles with large deterioration time difference separately, reducing the influence of the articles easy to deteriorate on the articles difficult to deteriorate, and prolonging the preservation time of the articles.

Fig. 6 is a schematic structural diagram of an intelligent refrigerator reminding device according to an embodiment of the present invention. According to the diagram provided in fig. 6, the specific structure of the intelligent refrigerator reminding device includes:

an acquiring module 61, configured to acquire article information and a position to be stored of an article to be stored in the intelligent refrigerator;

the acquiring module 61 is further configured to acquire item information of a stored item associated with a location to be stored;

a determining module 62 for determining the deterioration information of the article to be stored according to the article information of the article to be stored, and determining the deterioration information of the stored article according to the article information of the stored article;

a judging module 63, configured to judge whether the deterioration information of the article to be stored is consistent with the deterioration information of the stored article;

the reminding module 64 is configured to remind the item to be stored if the deterioration information of the item to be stored is inconsistent with the deterioration information of the stored item.

The intelligent refrigerator reminding device provided in this embodiment may be an intelligent refrigerator reminding device as shown in fig. 6, and may perform all steps of the intelligent refrigerator reminding method as shown in fig. 1-5, so as to achieve the technical effects of the intelligent refrigerator reminding method as shown in fig. 1-5, and the detailed description will be omitted herein for brevity.

Fig. 7 is a schematic structural diagram of an intelligent refrigerator according to an embodiment of the present invention, and the intelligent refrigerator 700 shown in fig. 7 includes: at least one processor 701, memory 702, at least one network interface 704, and other user interfaces 703. The various components in the intelligent refrigerator 700 are coupled together by a bus system 705. It is appreciated that the bus system 705 is used to enable connected communications between these components. The bus system 705 includes a power bus, a control bus, and a status signal bus in addition to the data bus. But for clarity of illustration, the various buses are labeled as bus system 705 in fig. 7.

The user interface 703 may include, among other things, a display, a keyboard, or a pointing device (e.g., a mouse, a trackball, a touch pad, or a touch screen, etc.).

It is to be appreciated that memory 702 in embodiments of the invention may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The nonvolatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable EPROM (EEPROM), or a flash Memory. The volatile memory may be random access memory (Random Access Memory, RAM) which acts as an external cache. By way of example, and not limitation, many forms of RAM are available, such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (Double Data Rate SDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), and Direct memory bus RAM (DRRAM). The memory 702 described herein is intended to comprise, without being limited to, these and any other suitable types of memory.

In some implementations, the memory 702 stores the following elements, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system 7021 and application programs 7022.

The operating system 7021 contains various system programs, such as a framework layer, a core library layer, a driver layer, and the like, for implementing various basic services and processing hardware-based tasks. The application programs 7022 include various application programs such as a Media Player (Media Player), a Browser (Browser), and the like for realizing various application services. A program for implementing the method of the embodiment of the present invention may be contained in the application program 7022.

In the embodiment of the present invention, the processor 701 is configured to execute the method steps provided by the method embodiments by calling a program or an instruction stored in the memory 702, specifically, a program or an instruction stored in the application program 7022, for example, including:

acquiring article information and a position to be stored of articles to be stored in the intelligent refrigerator; acquiring article information of a stored article associated with a position to be stored; determining the deterioration information of the article to be stored according to the article information of the article to be stored, and determining the deterioration information of the stored article according to the article information of the stored article; judging whether the deterioration information of the article to be stored is consistent with the deterioration information of the stored article; and reminding the article to be stored if the deterioration information of the article to be stored is inconsistent with the deterioration information of the stored article.

The method disclosed in the above embodiment of the present invention may be applied to the processor 701 or implemented by the processor 701. The processor 701 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in the processor 701 or by instructions in the form of software. The processor 701 described above may be a general purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be embodied directly in the execution of a hardware decoding processor, or in the execution of a combination of hardware and software elements in a decoding processor. The software elements may be located in a random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers, etc. as well known in the art. The storage medium is located in a memory 702, and the processor 701 reads information in the memory 702 and performs the steps of the method in combination with its hardware.

It is to be understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For a hardware implementation, the processing units may be implemented within one or more application specific integrated circuits (Application Specific Integrated Circuits, ASIC), digital signal processors (Digital Signal Processing, DSP), digital signal processing devices (dspev, DSPD), programmable logic devices (Programmable Logic Device, PLD), field programmable gate arrays (Field-Programmable Gate Array, FPGA), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units designed to perform the functions described herein, or a combination thereof.

For a software implementation, the techniques described herein may be implemented by means of units that perform the functions described herein. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.

The intelligent refrigerator provided in this embodiment may be an intelligent refrigerator as shown in fig. 7, and may perform all steps of the intelligent refrigerator reminding method as shown in fig. 1-5, so as to achieve the technical effects of the intelligent refrigerator reminding method as shown in fig. 1-5, and the detailed description will be omitted herein for brevity.

The embodiment of the invention also provides a storage medium (computer readable storage medium). The storage medium here stores one or more programs. Wherein the storage medium may comprise volatile memory, such as random access memory; the memory may also include non-volatile memory, such as read-only memory, flash memory, hard disk, or solid state disk; the memory may also comprise a combination of the above types of memories.

When one or more programs in the storage medium can be executed by one or more processors, the intelligent refrigerator reminding method executed on the intelligent refrigerator equipment side is realized.

The processor is used for executing the intelligent refrigerator reminding program stored in the memory so as to realize the following steps of the intelligent refrigerator reminding method executed on the intelligent refrigerator equipment side:

Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative elements and steps are described above generally in terms of function in order to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, in a software module executed by a processor, or in a combination of the two. The software modules may be disposed in Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

The foregoing description of the embodiments has been provided for the purpose of illustrating the general principles of the invention, and is not meant to limit the scope of the invention, but to limit the invention to the particular embodiments, and any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the invention are intended to be included within the scope of the invention.

Claims

1. An intelligent refrigerator reminding method is characterized by comprising the following steps:

2. The method of claim 1, wherein the acquiring the item information and the location to be stored of the item to be stored in the intelligent refrigerator comprises:

when a new object to be stored is detected to be added in the intelligent refrigerator, determining a position to be stored according to the moving track of the object to be stored;

3. The method of claim 1, wherein the acquiring item information for the stored item associated with the location to be stored comprises:

Acquiring an item image of an item associated with the location to be stored;

acquiring article attributes of the articles according to the article images, wherein the article attributes comprise article categories, article freshness characteristic information, packaging information and/or article parameters;

4. A method according to claim 3, wherein said determining the deterioration information of the item to be stored from the item information of the item to be stored and determining the deterioration information of the stored item from the item information of the stored item comprises:

judging whether the article information contains article parameters or not;

5. The method according to claim 4, wherein when the item information contains an item parameter, the item parameter is taken as the deterioration information, comprising:

acquiring article packaging information and an article packaging type in the article information;

determining the parameter type of the item parameter;

6. The method according to claim 5, further comprising:

when the article information does not contain the article parameters, the article packaging information is sent to a server;

7. The method of claim 6, wherein the determining the deterioration information of the item to be stored from the item information of the item to be stored and determining the deterioration information of the stored item from the item information of the stored item comprises:

8. The method of claim 7, wherein said determining whether the deterioration information of the object to be stored is consistent with the deterioration information of the stored object comprises:

9. The method of claim 8, wherein the method further comprises:

10. The method of claim 7, wherein the method further comprises:

11. The method according to claim 1, wherein the reminding of the stored item is performed if the deterioration information of the stored item is inconsistent with the deterioration information of the stored item _， Comprising the following steps:

and displaying the target position information of the object to be stored.

12. The method according to claim 1, characterized in that the method further comprises:

13. The method according to claim 1, characterized in that the method further comprises:

14. An intelligent refrigerator reminding method is characterized by comprising the following steps:

15. An intelligent refrigerator, comprising: the intelligent refrigerator reminding device comprises a processor and a memory, wherein the processor is used for executing an intelligent refrigerator reminding program stored in the memory so as to realize the intelligent refrigerator reminding method according to any one of claims 1 to 13.

16. A storage medium storing one or more programs executable by one or more processors to implement the intelligent refrigerator reminder method of any one of claims 1-13.