CN112665296B - Refrigerator based on data of Internet of things, and method and medium for intelligently detecting stored food - Google Patents

Refrigerator based on data of Internet of things, and method and medium for intelligently detecting stored food Download PDF

Info

Publication number
CN112665296B
CN112665296B CN202011384327.5A CN202011384327A CN112665296B CN 112665296 B CN112665296 B CN 112665296B CN 202011384327 A CN202011384327 A CN 202011384327A CN 112665296 B CN112665296 B CN 112665296B
Authority
CN
China
Prior art keywords
food
data
refrigerator
things
internet
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011384327.5A
Other languages
Chinese (zh)
Other versions
CN112665296A (en
Inventor
谢夏洋
李旭万
姚锐权
孙玉娇
辛冠恒
王兰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gree Electric Appliances Inc of Zhuhai
Original Assignee
Gree Electric Appliances Inc of Zhuhai
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gree Electric Appliances Inc of Zhuhai filed Critical Gree Electric Appliances Inc of Zhuhai
Priority to CN202011384327.5A priority Critical patent/CN112665296B/en
Publication of CN112665296A publication Critical patent/CN112665296A/en
Application granted granted Critical
Publication of CN112665296B publication Critical patent/CN112665296B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

The invention belongs to the technical field of intelligent home furnishing, and discloses a refrigerator based on data of the Internet of things, an intelligent detection method and a medium for stored food, wherein a separation device is arranged on the refrigerator with a hollow internal space, a plurality of partition plates are distributed in the refrigerator according to layers, and the partition plates are supported and connected by support columns; the pressure detection system is characterized in that four corners of each partition board are respectively distributed with a pressure sensor and an orientation recognition device, and when food is put in, three or more sensors are used for comprehensively sensing the orientation of the food; the gravity sensing device is characterized in that a plurality of gravity sensors are arranged on the lower side of the bottom clapboard supporting plate; the image detection system is arranged on a plurality of cameras on the inner wall of the space in the refrigerator and used for identifying and distinguishing specific food through images. On the basis of this, the health management of the user can be assisted at the food level in daily use. The food information in the refrigerator can be intelligently recorded, and a blending suggestion can be intelligently given according to the food information.

Description

Refrigerator based on data of Internet of things, and method and medium for intelligently detecting stored food
Technical Field
The invention belongs to the technical field of intelligent home furnishing, and particularly relates to a refrigerator based on data of the Internet of things, an intelligent detection method for stored food and a medium.
Background
The refrigerator belongs to the indispensable household electrical appliances of family, nevertheless still uses basic refrigeration fresh-keeping function to a great extent in using at present, and the food information of its inner space storage can further develop and utilize based on thing networking data acquisition, enriches its use scene, makes it possess the practicality more.
Through the above analysis, the problems and defects of the prior art are as follows: at present, only the basic refrigeration and preservation functions are used to a greater extent, and the refrigeration and preservation device is single in function and cannot meet the requirements of people.
Disclosure of Invention
In order to solve the problems in the prior art, the invention provides a refrigerator based on data of the Internet of things, an intelligent detection method and a medium for stored food.
The invention is realized in this way, and the intelligent detection system for the food stored in the refrigerator based on the data of the Internet of things is provided with:
the separation device is placed on a refrigerator with a hollow internal space, a plurality of partition plates are distributed in the refrigerator according to layers, and the partition plates are supported and connected through support columns;
in the pressure detection system, pressure sensors are respectively distributed at four corners of each partition plate,
the direction recognition device is used for comprehensively sensing the direction of the food by three or more sensors when the food is put in;
the gravity sensing device is characterized in that a plurality of gravity sensors are arranged on the lower side of the bottom clapboard supporting plate;
the image detection system is arranged on a plurality of cameras on the inner wall of the space in the refrigerator and used for identifying and distinguishing specific food through images.
The invention also aims to provide a detection method of the intelligent detection system for the foods stored in the refrigerator based on the data of the internet of things, which comprises the following steps:
step one, identifying specific types of food, and classifying and identifying the food by building a neural network model;
step two, combining the weight information to obtain relatively accurate energy data;
and step three, developing and utilizing food information stored in the internal space of the refrigerator based on data acquisition of the Internet of things and giving a blending suggestion.
Furthermore, in the first step, articles are taken and placed on the interlayer, one side, where the articles are placed, is slightly inclined under stress, the corresponding interlayer pressure sensor judges the number of corresponding interlayers and places specific positions based on the force, and the corresponding positions are subjected to image recognition by the camera on the inner wall of the refrigerator space.
Furthermore, in the second step, the corresponding positions of the food are detected through the induction of a plurality of pressure sensors, and after the whole picture is calibrated according to regions in the previous period, the positioning and the identification are rapidly realized.
Further, in the third step, the first step,
under the condition that non-food is identified, the system reserves the current spatial position image and weight information for the next identification and comparison;
in the case where food is identified, the bottommost shelf weight sensor detects the difference in weight before and after and records the comparison.
Further, if the weight is increased compared with the original weight, the food is judged to be put in, and the calorie of the food is comprehensively judged by combining the health data of the user to give a specific diet suggestion;
if the weight is reduced compared with the original weight, judging that the food is taken out, judging that the calorie consumed by the food is taken out by combining the health data of the user, and giving a specific purchasing suggestion;
after the comparison record is finished, the system continuously keeps the current spatial position image and the weight information for the next identification comparison;
if the weight is not changed, the judgment is regarded as misjudgment, misjudgment information is recorded, the current spatial position image and the weight information are continuously kept, and the whole process is finished.
The invention also aims to provide a refrigerator, which is provided with the intelligent detection system for foods stored in the refrigerator based on the data of the internet of things and is used for implementing the intelligent detection method for the foods stored in the refrigerator based on the data of the internet of things.
Another object of the present invention is to provide a computer device, which includes a memory and a processor, wherein the memory stores a computer program, and the computer program, when executed by the processor, causes the processor to execute the method for intelligently detecting food stored in a refrigerator based on data of internet of things.
Another object of the present invention is to provide a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the processor is enabled to execute the method for intelligently detecting foods stored in a refrigerator based on data of the internet of things.
The invention also aims to provide an information data processing terminal which is used for realizing the intelligent detection method for the food stored in the refrigerator based on the data of the internet of things.
By combining all the technical schemes, the invention has the advantages and positive effects that: the intelligent detection system for the food stored in the refrigerator based on the data of the Internet of things can assist a user in health management on the food level based on the daily use. Food information in the refrigerator can be intelligently recorded, and a blending suggestion can be intelligently given according to the food information.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained from the drawings without creative efforts.
Fig. 1 is a flowchart of an intelligent detection method for food stored in a refrigerator based on data of the internet of things, provided by the embodiment of the invention.
Fig. 2 is an internal schematic view of an intelligent detection system for food stored in a refrigerator based on data of the internet of things, provided by the embodiment of the invention.
Fig. 3 is a schematic plan view of an intelligent detection system for food stored in a refrigerator based on data of the internet of things, provided by the embodiment of the invention.
In the figure: 1. a camera; 2. a pressure sensor; 3. a support pillar; 4. a gravity sensor.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Aiming at the problems in the prior art, the invention provides an intelligent detection system and method for food stored in a refrigerator based on data of the Internet of things, and the invention is described in detail with reference to the attached drawings.
As shown in fig. 1, the invention provides a detection method of an intelligent detection system for food stored in a refrigerator based on data of the internet of things, which comprises the following steps:
step one, identifying specific types of food, and classifying and identifying the food by building a neural network model;
step two, combining the weight information to obtain relatively accurate energy data;
and step three, developing and utilizing food information stored in the internal space of the refrigerator based on data acquisition of the Internet of things and giving a blending suggestion.
In the first step, articles are taken and placed on the interlayer, one side of the article where the articles are placed is slightly inclined under stress, the corresponding interlayer pressure sensor judges the number of corresponding interlayers and places specific positions based on the force, and the corresponding positions are subjected to image recognition by the camera on the inner wall of the refrigerator space.
In the second step, the corresponding positions of the food are detected through the induction of a plurality of pressure sensors, and after the whole picture is calibrated according to regions in the previous period, the positioning and the identification are rapidly realized.
In the third step, under the condition that non-food is identified, the system reserves the current spatial position image and the weight information for the next identification and comparison;
in the case where food is identified, the bottommost shelf weight sensor detects the difference in weight before and after and records the comparison.
If the weight is increased compared with the original weight, the food is judged to be put in, and the calorie of the food is comprehensively judged by combining the health data of the user to give a specific diet suggestion;
if the weight is reduced compared with the original weight, judging that the food is taken out, judging that the calorie consumed by the food is taken out by combining the health data of the user, and giving a specific purchasing suggestion;
after the comparison record is finished, the system continuously keeps the current spatial position image and the weight information for the next identification comparison;
if the weight is not changed, the judgment is regarded as misjudgment, misjudgment information is recorded, the current spatial position image and the weight information are continuously kept, and the whole process is finished.
As shown in fig. 2 to 3, the intelligent detection system for food stored in a refrigerator based on data of the internet of things of the present invention includes: camera 1, pressure sensor 2, support column 3, gravity sensor 4.
When the specific type of food needs to be identified, the food is classified and identified by building a neural network model, and relatively accurate energy data is obtained by combining weight information. Food information stored in the internal space of the refrigerator is developed and utilized based on data acquisition of the Internet of things, and a blending suggestion is given.
The refrigerator is hollow in internal space, a plurality of partition plates are distributed in layers, and the partition plates are supported and connected by support columns; pressure sensors are respectively distributed at four corners of each partition plate, and when food is put in, the orientation of the food is comprehensively sensed by three or more sensors; and (4) judging the orientation of the food, quickly positioning the corresponding position of the image during identification, and accurately judging various information of the food. A gravity sensor is arranged on the lower side of the supporting plate of the bottom clapboard and used for sensing the weight change of articles placed in the refrigerator; the camera is placed on the inner wall of the space and used for identifying and distinguishing specific food through images.
The technical solution of the present invention is further described below with reference to examples.
Examples
The invention aims to provide a comprehensive improvement scheme for the space utilization rate of a refrigerator for a user. The user opens the refrigerator and gets to put article on going up the interlayer, and article are placed one side and then the atress takes place slight slope, correspond interlayer pressure sensor then based on this judgement correspond the interlayer number of piles and place concrete position, carry out image recognition to corresponding position by camera on the refrigerator space inner wall. The corresponding positions of food can be detected through the induction of a plurality of pressure sensors, and after the whole picture is calibrated according to regions in the prior period, the positioning and the identification can be quickly realized.
If no food is identified, the system retains the current spatial position image and weight information for the next identification comparison.
In the case where food is identified, the bottommost shelf weight sensor detects the difference in weight before and after and records the comparison.
If the weight is increased compared with the original weight, the food is judged to be put in, and the calorie of the food is comprehensively judged by combining the health data of the user, so that specific dietary suggestions (such as a menu, cooking amount and the like) are given;
if the weight is reduced compared with the original weight, judging that the food is taken out, judging that the calorie consumed by the food is taken out by combining the health data of the user, and giving a specific purchasing suggestion;
after the comparison record is completed, the system continuously keeps the current spatial position image and the weight information for the next identification comparison.
If the weight is not changed, the judgment is regarded as misjudgment, misjudgment information is recorded, the current spatial position image and the weight information are continuously kept, and the whole process is finished.
In the description of the invention, "a plurality" means two or more unless otherwise specified; the terms "upper", "lower", "left", "right", "inner", "outer", "front", "rear", "head", "tail", and the like, indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, are merely for convenience in describing the invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a particular orientation, be constructed in a particular orientation, and be operated, and thus, should not be construed as limiting the invention. Furthermore, the terms "first," "second," "third," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
The above description is only for the specific embodiments of the invention, but the scope of the invention is not limited thereto, and any modifications, equivalents and improvements made by those skilled in the art within the technical scope of the invention disclosed herein are all within the spirit and principle of the invention.

Claims (8)

1. The detection method of the intelligent detection system for the food stored in the refrigerator based on the data of the Internet of things is characterized in that the intelligent detection system for the food stored in the refrigerator based on the data of the Internet of things is provided with the following components:
the separation device is placed on a refrigerator with a hollow internal space, a plurality of partition plates are distributed in the refrigerator according to layers, and the partition plates are supported and connected through support columns;
in the pressure detection system, pressure sensors are respectively distributed at four corners of each partition plate,
the direction recognition device is used for comprehensively sensing the direction of the food by three or more sensors when the food is put in;
the gravity sensing device is characterized in that a plurality of gravity sensors are arranged on the lower side of the bottom clapboard supporting plate;
the image detection system is arranged on a plurality of cameras on the inner wall of the space in the refrigerator and used for identifying and distinguishing specific foods;
the intelligent detection method for food stored in the refrigerator based on data of the Internet of things comprises the following steps:
step one, identifying specific types of food, and classifying and identifying the food by building a neural network model;
step two, combining the weight information to obtain relatively accurate energy data;
thirdly, developing and utilizing food information stored in the internal space of the refrigerator based on data acquisition of the Internet of things and giving a blending suggestion; in the third step, the first step is carried out,
under the condition that non-food is identified, the system reserves the current spatial position image and weight information for the next identification and comparison;
in the case where food is identified, the bottommost shelf weight sensor detects the difference in weight before and after and records the comparison.
2. The intelligent detection method for the foods stored in the refrigerator based on the data of the internet of things as claimed in claim 1, wherein in the first step, articles are taken and placed on the interlayer, one side where the articles are placed is slightly inclined under stress, the number of the corresponding interlayers and the specific positions where the corresponding interlayer pressure sensors are placed are judged based on the articles, and the corresponding positions are subjected to image recognition by a camera on the inner wall of the space of the refrigerator.
3. The intelligent detection method for foods stored in the refrigerator based on the data of the internet of things as claimed in claim 1, wherein in the second step, the corresponding positions of the foods are detected through the induction of a plurality of pressure sensors, and after the whole picture is calibrated according to regions in the previous period, the positioning and the identification are rapidly realized.
4. The intelligent detection method for food stored in the refrigerator based on the data of the internet of things as claimed in claim 1, wherein if the weight is increased compared with the original weight, the food is judged to be put in, and the calorie of the food is comprehensively judged by combining with the health data of the user to give a specific diet suggestion;
if the weight is reduced compared with the original weight, judging that the food is taken out, judging that the calorie consumed by the food is taken out by combining with the health data of the user, and giving a specific purchase suggestion;
after the comparison record is finished, the system continuously keeps the current spatial position image and the weight information for the next identification comparison;
if the weight is not changed, the judgment is regarded as misjudgment, misjudgment information is recorded, the current spatial position image and the weight information are continuously kept, and the whole process is finished.
5. The refrigerator is provided with the intelligent detection system for the foods stored in the refrigerator based on the data of the internet of things as claimed in claim 1, and is used for implementing the intelligent detection method for the foods stored in the refrigerator based on the data of the internet of things as claimed in claims 1 to 4.
6. A computer device, characterized in that the computer device comprises a memory and a processor, the memory stores a computer program, and the computer program when executed by the processor causes the processor to execute the method for intelligently detecting foods in refrigerator based on data of internet of things according to claims 1-4.
7. A computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to execute the method for intelligently detecting foods stored in a refrigerator based on data of the internet of things of claims 1-4.
8. An information data processing terminal, characterized in that the information data processing terminal is used for realizing the intelligent detection method for food stored in the refrigerator based on data of the internet of things as claimed in claims 1 to 4.
CN202011384327.5A 2020-12-01 2020-12-01 Refrigerator based on data of Internet of things, and method and medium for intelligently detecting stored food Active CN112665296B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011384327.5A CN112665296B (en) 2020-12-01 2020-12-01 Refrigerator based on data of Internet of things, and method and medium for intelligently detecting stored food

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011384327.5A CN112665296B (en) 2020-12-01 2020-12-01 Refrigerator based on data of Internet of things, and method and medium for intelligently detecting stored food

Publications (2)

Publication Number Publication Date
CN112665296A CN112665296A (en) 2021-04-16
CN112665296B true CN112665296B (en) 2022-08-12

Family

ID=75400839

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011384327.5A Active CN112665296B (en) 2020-12-01 2020-12-01 Refrigerator based on data of Internet of things, and method and medium for intelligently detecting stored food

Country Status (1)

Country Link
CN (1) CN112665296B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116182463A (en) * 2021-11-25 2023-05-30 海信集团控股股份有限公司 Detection equipment, refrigerator and method for identifying access behaviors of user to food materials in refrigerator
CN114353422B (en) * 2021-12-13 2023-01-24 珠海格力电器股份有限公司 Sorting apparatus, refrigerator, sorting method, and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104697270A (en) * 2015-03-19 2015-06-10 合肥华凌股份有限公司 Refrigerator
CN106546063A (en) * 2016-10-17 2017-03-29 青岛海尔股份有限公司 The food information management method of refrigerating device and system
CN107806732A (en) * 2017-10-20 2018-03-16 浙江凯普顿厨房设备有限公司 A kind of adaptive frost-free refrigerator
CN213208332U (en) * 2020-08-14 2021-05-14 山西盛顺绿洲农业开发有限责任公司 Fruit and vegetable fresh-keeping device

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3648138B2 (en) * 2000-03-27 2005-05-18 三菱電機株式会社 refrigerator
JP2002303479A (en) * 2001-03-30 2002-10-18 Toshiba Corp Refrigerator
CN102564053B (en) * 2012-03-02 2015-03-25 合肥美的电冰箱有限公司 Refrigerator and method for controlling same
CN102645083A (en) * 2012-05-24 2012-08-22 南京大学 Intelligent refrigerator based on radio frequency recognition technology and working method thereof
KR102000448B1 (en) * 2013-03-27 2019-10-01 엘지전자 주식회사 Refrigerator
CN103822432A (en) * 2014-02-25 2014-05-28 四川长虹电器股份有限公司 Refrigerator
CN105043005A (en) * 2015-06-16 2015-11-11 合肥华凌股份有限公司 System and method for managing refrigerator food information
CN105258443A (en) * 2015-11-06 2016-01-20 青岛海尔股份有限公司 Rack system and control method thereof
CN205939882U (en) * 2016-08-04 2017-02-08 合肥微纳传感技术有限公司 Refrigerator of intelligence food storage sterilization
US10520352B1 (en) * 2016-12-22 2019-12-31 Amazon Technologies, Inc. System to validate load cell data
CN107525345A (en) * 2017-10-18 2017-12-29 湖州升谱电子科技有限公司 A kind of Internet of Things intelligent refrigerator
CN108332504B (en) * 2017-12-08 2020-11-06 青岛海尔智能技术研发有限公司 Food heat detection method and refrigerator
CN108759294A (en) * 2018-07-14 2018-11-06 王长贵 A kind of refrigerator intelligent recognition and management system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104697270A (en) * 2015-03-19 2015-06-10 合肥华凌股份有限公司 Refrigerator
CN106546063A (en) * 2016-10-17 2017-03-29 青岛海尔股份有限公司 The food information management method of refrigerating device and system
CN107806732A (en) * 2017-10-20 2018-03-16 浙江凯普顿厨房设备有限公司 A kind of adaptive frost-free refrigerator
CN213208332U (en) * 2020-08-14 2021-05-14 山西盛顺绿洲农业开发有限责任公司 Fruit and vegetable fresh-keeping device

Also Published As

Publication number Publication date
CN112665296A (en) 2021-04-16

Similar Documents

Publication Publication Date Title
CN112665296B (en) Refrigerator based on data of Internet of things, and method and medium for intelligently detecting stored food
WO2019184646A1 (en) Method and device for identifying merchandise, merchandise container
WO2020037933A1 (en) Unmanned vending machine
CN110347772A (en) Article condition detection method, device and computer readable storage medium
WO2019161734A1 (en) Self-service vending device and vending method thereof, and self-service vending system
CN106052294A (en) Refrigerator and method for judging change of objects in object storage area of refrigerator
CN101651824B (en) Mobile object monitoring device
CN110260796A (en) Kinds of goods sensory perceptual system, kinds of goods cognitive method and electronic equipment
CN106766650B (en) For detecting the method for whether being put into temperature anomaly article in refrigerator
KR102017980B1 (en) Refrigerator with displaying image by identifying goods using artificial intelligence and method of displaying thereof
CN113465264A (en) Intelligent refrigerator and food material management method
CN106766646B (en) For detecting the method for whether being put into temperature anomaly article in refrigerator
CN111831673A (en) Goods identification system, goods identification method and electronic equipment
CN109993891A (en) The control method of Weighing type Intelligent cargo cabinet
CN108895756B (en) Method and apparatus for displaying caloric value of food for refrigerator
Ege et al. Simultaneous estimation of dish locations and calories with multi-task learning
CN111310610B (en) Goods identification method, goods identification system and electronic equipment
TWI712903B (en) Commodity information inquiry method and system
CN113874678A (en) Food measuring method, device and program
US20230128689A1 (en) Extrinsic camera calibration using calibration object
CN108332504B (en) Food heat detection method and refrigerator
CN212481823U (en) Intelligent cooling and heating cabinet
CN111127750A (en) Commodity displacement identification method based on gravity sensor data
CN113483525A (en) Preservation equipment and food material management method
CN112741427A (en) Method for extracting articles from storage system and storage system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant