CN113051421A - Range hood, food material identification method and cooking auxiliary method - Google Patents
Range hood, food material identification method and cooking auxiliary method Download PDFInfo
- Publication number
- CN113051421A CN113051421A CN201911388231.3A CN201911388231A CN113051421A CN 113051421 A CN113051421 A CN 113051421A CN 201911388231 A CN201911388231 A CN 201911388231A CN 113051421 A CN113051421 A CN 113051421A
- Authority
- CN
- China
- Prior art keywords
- food material
- food
- image
- sample set
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/5838—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
- F24C15/00—Details
- F24C15/20—Removing cooking fumes
- F24C15/2021—Arrangement or mounting of control or safety systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
The invention relates to the technical field of kitchen household appliances, and discloses a range hood, a food material identification method and a cooking auxiliary method.
Description
Technical Field
The invention relates to the technical field of range hoods, in particular to a range hood, a food material identification method and a cooking auxiliary method.
Background
At present, a range hood is a common kitchen appliance, which is installed above a kitchen range and used for discharging oil smoke generated in the process of using the kitchen range outdoors. At present, in order to improve the intelligent degree of lampblack absorber, people realize function such as culinary art process is supplementary through setting up the camera on some lampblack absorbers, for example through the camera discernment edible material kind to be convenient for the suggestion user how to cook etc. however, prior art's edible material recognition effect is relatively poor.
Disclosure of Invention
The embodiment of the invention aims to provide a range hood, a food material identification method and a cooking auxiliary method, which can obtain a better food material identification effect.
In order to solve the technical problem, an embodiment of the present invention provides a range hood, including a first image acquisition device and a control device;
the first image acquisition device is used for acquiring food material images and sending the food material images to the control device;
the control device is used for:
receiving the food material image;
determining the food material color of the food material image according to the food material image;
finding out all food material samples matched with the food material colors of the food material images from a pre-established database to obtain a first food material sample set; the database stores a plurality of food material samples, and each food material sample comprises the food material color, the food material shape, the food material appearance characteristic and the food material size of a corresponding food material;
according to the food material image, determining food material shape information, food material appearance characteristic information and food material size information of the food material image, finding out all food material samples matched with the food material shape information, the food material appearance characteristic information and the food material size information of the food material image from the first food material sample set, and obtaining a food material identification result.
As a preferred scheme, the control device is configured to determine, according to the food material image, food material shape information, food material appearance characteristic information, and food material size information of the food material image, and find out all food material samples matching the food material shape information, the food material appearance characteristic information, and the food material size information of the food material image from the first food material sample set, and specifically includes:
the control device is used for:
carrying out gray level processing on the food material image;
performing edge detection on the food material image subjected to gray level processing to obtain food material shape information of the food material image;
finding out all food material samples matched with the food material shape information of the food material images from the first food material sample set to obtain a second food material sample set;
determining the food material appearance characteristic information of the food material image according to the food material image subjected to gray level processing;
finding out all food material samples matched with the food material appearance characteristic information of the food material images from the second food material sample set to obtain a third food material sample set;
determining food material size information of the food material image according to the food material image subjected to gray level processing;
finding out all food material samples matched with the food material size information of the food material images from the third food material sample set to obtain a fourth food material sample set, and obtaining a food material identification result according to the fourth food material sample set.
As a preferred scheme, the range hood further comprises a second image acquisition device, wherein the second image acquisition device is used for acquiring food images in the pan in real time and sending the food images in the pan acquired in real time to the control device;
the control means is further adapted to:
determining the type of food in the current pot according to the food material identification result;
acquiring a preset mapping table corresponding to the type of the food in the current pot according to the type of the food in the current pot; wherein the preset mapping table records the mapping relation between the food color range and the food maturity;
receiving food images in the pan acquired by a second image acquisition device in real time;
determining a color value of food in the current pot according to the image of the food in the pot;
determining the food maturity degree in the current pot according to the preset mapping table and the color value of the food in the current pot;
and outputting prompt information according to the current degree of maturity of the food in the pot.
As a preferred scheme, the range hood further comprises a casing, and a first window and a second window are formed in the casing;
the first image acquisition device comprises a first camera, a first transparent protection layer and a first oil-proof protection cover, and the first oil-proof protection cover is connected to the inner side wall of the shell to form a first containing cavity; the first camera is accommodated in the first accommodating cavity; the first transparent protection layer is arranged on the first window, and the first camera is arranged opposite to the first transparent protection layer;
the second image acquisition device comprises a second camera, a second transparent protection layer and a second oil-proof protection cover, and the second oil-proof protection cover is connected to the inner side wall of the shell to form a second containing cavity; the second camera is accommodated in the second accommodating cavity; the second transparent protection layer is arranged on the second window, and the second camera is arranged opposite to the second transparent protection layer;
the control device is electrically connected with the first camera and the second camera respectively.
Preferably, the first window is opened on a side surface of the housing, and the second window is opened on a front surface of the housing.
Preferably, the first image capturing device further includes:
the first fixing support is accommodated in the first accommodating cavity and comprises a first connecting part and a second connecting part, one end of the first camera is connected to the inner side wall of the shell through the first connecting part, and the other end of the first camera is connected to the inner side wall of the shell through the second connecting part; and
the second fixed bolster, the second fixed bolster holding is in the second holds the intracavity, the second fixed bolster includes third connecting portion and fourth connecting portion, the one end of second camera is passed through third connecting portion connect on the casing, the other end of second camera passes through fourth connecting portion connect on the casing.
As a preferred scheme, the range hood further comprises a fan control output module, a voice output module, a key input module and an illuminating lamp, wherein the control device is electrically connected with the fan control output module, the voice output module, the key input module and the illuminating lamp respectively.
In order to solve the same technical problem, an embodiment of the present invention further provides a food material identification method, including:
receiving a food material image acquired by a first image acquisition device;
determining the food material color of the food material image according to the food material image;
finding out all food material samples matched with the food material colors of the food material images from a pre-established database to obtain a first food material sample set; the database stores a plurality of food material samples, and each food material sample comprises the food material color, the food material shape, the food material appearance characteristic and the food material size of a corresponding food material;
according to the food material image, determining food material shape information, food material appearance characteristic information and food material size information of the food material image, finding out all food material samples matched with the food material shape information, the food material appearance characteristic information and the food material size information of the food material image from the first food material sample set, and obtaining a food material identification result.
As a preferred scheme, the determining, according to the food material image, the food material shape information, the food material appearance characteristic information, and the food material size information of the food material image, and finding out all food material samples matched with the food material shape information, the food material appearance characteristic information, and the food material size information of the food material image from the first food material sample set specifically include:
carrying out gray level processing on the food material image;
performing edge detection on the food material image subjected to gray level processing to obtain food material shape information of the food material image;
finding out all food material samples matched with the food material shape information of the food material images from the first food material sample set to obtain a second food material sample set;
determining the food material appearance characteristic information of the food material image according to the food material image subjected to gray level processing;
finding out all food material samples matched with the food material appearance characteristic information of the food material images from the second food material sample set to obtain a third food material sample set;
determining food material size information of the food material image according to the food material image subjected to gray level processing;
finding out all food material samples matched with the food material size information of the food material images from the third food material sample set to obtain a fourth food material sample set, and obtaining a food material identification result according to the fourth food material sample set.
As a preferred scheme, the performing edge detection on the food material image after the gray processing to obtain the food material shape information of the food material image specifically includes:
determining the gray value of each pixel point in the food material image after graying processing;
acquiring all pixel points of which the difference value between the gray values of two adjacent pixel points is greater than or equal to a preset gray difference threshold value, and correspondingly generating a line graph;
and obtaining the food material shape information of the food material image according to the line graph.
As a preferred scheme, each food material sample further comprises the food material type of the corresponding food material;
finding out all food material samples matched with the food material size information of the food material image from the third food material sample set to obtain a fourth food material sample set, and obtaining a food material identification result according to the fourth food material sample set, further comprising:
obtaining the number of food material samples of the fourth food material sample set;
when the number of the food material samples in the fourth food material sample set is greater than or equal to 1, outputting the food material types of all the food material samples in the fourth food material sample set;
and when no food material sample exists in the fourth food material sample set, outputting a recognition failure result.
In order to solve the same technical problem, an embodiment of the present invention further provides a cooking assistance method, including:
acquiring a food material identification result by the food material identification method;
determining the type of food in the current pot according to the food material identification result;
acquiring a preset mapping table corresponding to the type of the food in the current pot according to the type of the food in the current pot; wherein the preset mapping table records the mapping relation between the food color range and the food maturity;
receiving food images in the pan acquired by a second image acquisition device in real time;
determining a color value of food in the current pot according to the image of the food in the pot;
determining the food maturity degree in the current pot according to the preset mapping table and the color value of the food in the current pot;
and outputting prompt information according to the current degree of maturity of the food in the pot.
The embodiment of the invention provides a range hood, a food material identification method and a cooking auxiliary method, wherein a food material image acquired by a first image acquisition device is used, the food material color corresponding to the food material image is determined according to the food material image, all food material samples matched with the food material image are found out from a pre-established database to obtain a first food material sample set, then the food material shape information, the food material appearance characteristic information and the food material size information of the food material image are determined according to the food material image, all food material samples matched with the information are found out from the first food material sample set, so that a food material identification result is obtained, the food material samples meeting conditions are screened according to different conditions, the accurate identification of food materials is facilitated, and a better food material identification effect is achieved; in addition, the first food material sample set which accords with the food material colors is found out, and then food material sample screening is further carried out on the first food material sample set, so that repeated matching of food material samples which do not accord with conditions is avoided, and the identification efficiency is improved.
Drawings
FIG. 1 is a schematic structural diagram of one embodiment of a range hood provided by the present invention;
FIG. 2 is a cross-sectional view taken along A-A of FIG. 1;
FIG. 3 is an enlarged view of a portion of FIG. 2 at C;
FIG. 4 is a cross-sectional view taken along line B-B of FIG. 1;
FIG. 5 is an enlarged view of a portion of FIG. 4 at D;
FIG. 6 is a control relationship diagram of one embodiment of a range hood provided by the present invention;
FIG. 7 is a control relationship diagram of another embodiment of a range hood provided by the present invention;
fig. 8 is a flowchart illustrating an embodiment of a food material identification method according to the present invention;
FIG. 9 is a schematic flow chart diagram illustrating one embodiment of a cooking assistance method provided by the present invention;
wherein, 1, a shell; 2. a first image acquisition device; 21. a first camera; 22. a first transparent protective layer; 23. a first oil resistant protective cover; 241. a first connection portion; 242. a second connecting portion; 3. a second image acquisition device; 31. a second camera; 32. a second transparent protective layer; 33. a second oil resistant protective cover; 341. a third connecting portion; 342. a fourth connecting portion; 4. a control device; 5. a voice output module; 6. a key input module; 7. an illuminating lamp; 8. and a fan control output module.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1 and 6, fig. 1 is a schematic structural diagram of an embodiment of a range hood provided by the present invention, and fig. 6 is a control relationship diagram of an embodiment of a range hood provided by the present invention.
The range hood of the preferred embodiment of the invention comprises a first image acquisition device 2 and a control device 4;
the first image acquisition device 2 is used for acquiring food material images and sending the food material images to the control device;
the control device 4 is configured to:
receiving the food material image;
determining the food material color of the food material image according to the food material image;
finding out all food material samples matched with the food material colors of the food material images from a pre-established database to obtain a first food material sample set; the database stores a plurality of food material samples, and each food material sample comprises the food material color, the food material shape, the food material appearance characteristic and the food material size of a corresponding food material;
according to the food material image, determining food material shape information, food material appearance characteristic information and food material size information of the food material image, finding out all food material samples matched with the food material shape information, the food material appearance characteristic information and the food material size information of the food material image from the first food material sample set, and obtaining a food material identification result.
In the embodiment of the invention, the food material images acquired by the first image acquisition device 2 are used, the food material colors corresponding to the food material images are determined according to the food material images, all food material samples matched with the food material images are found out from a pre-established database to obtain a first food material sample set, then the food material shape information, the food material appearance characteristic information and the food material size information of the food material images are determined according to the food material images, all food material samples matched with the information are found out from the first food material sample set, so that a food material identification result is obtained, the food material samples meeting the conditions are screened according to different conditions, the accurate identification of food materials is facilitated, and a better food material identification effect is achieved; in addition, the first food material sample set which accords with the food material colors is found out, and then food material sample screening is further carried out on the first food material sample set, so that repeated matching of food material samples which do not accord with conditions is avoided, and the identification efficiency is improved.
In an optional embodiment, the control device 4 is configured to determine, according to the food material image, food material shape information, food material appearance characteristic information, and food material size information of the food material image, and find out all food material samples matching the food material shape information, the food material appearance characteristic information, and the food material size information of the food material image from the first food material sample set, and specifically includes:
the control device 4 is configured to:
carrying out gray level processing on the food material image;
performing edge detection on the food material image subjected to gray level processing to obtain food material shape information of the food material image;
finding out all food material samples matched with the food material shape information of the food material images from the first food material sample set to obtain a second food material sample set;
determining the food material appearance characteristic information of the food material image according to the food material image subjected to gray level processing;
finding out all food material samples matched with the food material appearance characteristic information of the food material images from the second food material sample set to obtain a third food material sample set;
determining food material size information of the food material image according to the food material image subjected to gray level processing;
finding out all food material samples matched with the food material size information of the food material images from the third food material sample set to obtain a fourth food material sample set, and obtaining a food material identification result according to the fourth food material sample set.
The food material shape feature information of the food material image may be food material features that can be easily identified, such as a scalpeloid feature of a tomato, a dotted feature of a cucumber, and the like, and may be pre-stored in a database according to actual requirements.
In the embodiment of the invention, the food material image is subjected to gray level processing, the food material shape information of the food material image is obtained through edge detection, the second food material sample set matched with the food material shape information is found out from the first food material sample set, the third food material sample set matched with the food material appearance characteristic information of the food material image is found out from the second food material sample set, and the fourth food material sample set matched with the food material size information of the food material image is found out from the third food material sample set, so that the food material samples meeting various conditions are screened step by step, repeated matching of the food material samples not meeting the conditions is avoided, and the identification efficiency is improved.
In an optional embodiment, the control device 4 is configured to perform edge detection on the food material image after the gray processing to obtain food material shape information of the food material image, and specifically includes:
the control device 4 is configured to:
determining the gray value of each pixel point in the food material image after graying processing;
acquiring all pixel points of which the difference value between the gray values of two adjacent pixel points is greater than or equal to a preset gray difference threshold value, and correspondingly generating a line graph;
and obtaining the food material shape information of the food material image according to the line graph.
In the specific implementation, because the colors of the food materials generally have a large difference from the colors of the environment in which the food materials are located, for example, when tomatoes are placed on a chopping board, the photographed food material image contains the tomatoes and the chopping board, and pixel points with large gray value difference between adjacent pixel points can be found out, so that the shape information of the tomatoes is obtained. The preset gray difference threshold may be set according to actual requirements, and further details are not described herein.
In an alternative embodiment, each of the food material samples further comprises a food material category (i.e. food material name) of the respective food material; the control means 4 are also adapted to:
finding all food material samples matched with the food material size information of the food material images from the third food material sample set to obtain a fourth food material sample set, and obtaining the number of food material samples of the fourth food material sample set after obtaining a food material identification result according to the fourth food material sample set;
when the number of the food material samples in the fourth food material sample set is greater than or equal to 1, outputting the food material types of all the food material samples in the fourth food material sample set;
and when no food material sample exists in the fourth food material sample set, outputting a recognition failure result.
In specific implementation, the food material identification result can be output through a display screen or voice broadcast and other modes. When the number of the food material samples in the fourth food material sample set is multiple, the user can confirm which food material sample is the actual food material, for example, by using a touch screen, a key, or voice control.
The following illustrates a process of identifying food materials of the range hood provided by the embodiment of the present invention:
for example, identifying the tomatoes, firstly, photographing the food through the first image acquisition device 2, and storing the food as a first picture; then, the color of the first picture is obtained through the first image acquisition device 2, and a food material sample matched with the color is selected from a database, for example, the tomato is red, and red foods comprise tomatoes, pork, apples, cherry tomatoes and hot peppers; then, the first picture is processed with gray scale to generate a second picture (black and white picture); performing edge detection on the second picture to obtain the shape of the current food material, comparing the shape with the shape of the selected red food, and further selecting foods with similar shapes, such as tomatoes approaching to a circle, wherein the circular foods comprise tomatoes, pork, apples and cherry tomatoes; further identifying the appearance characteristics of the food, such as tomatoes having acicular petals, finding out the food with the acicular characteristics from the circular food, wherein the food with the acicular characteristics comprises tomatoes and cherry tomatoes; then, when the size of the food is recognized, if the diameter of tomatoes is generally 5 to 10cm and the diameter of cherry tomatoes is generally 1 to 2cm, the food can be correctly recognized as tomatoes. Finally, after the identification is successful, the identified food is reported to be tomatoes through voice broadcasting.
In an optional implementation manner, the range hood further comprises a second image acquisition device 3, wherein the second image acquisition device 3 is used for acquiring food images in the pan in real time and sending the food images in the pan acquired in real time to the control device 4; the control means 4 are also adapted to:
determining the type of food in the current pot according to the food material identification result;
acquiring a preset mapping table corresponding to the type of the food in the current pot according to the type of the food in the current pot; wherein the preset mapping table records the mapping relation between the food color range and the food maturity;
receiving food images in the pan acquired by the second image acquisition device 3 in real time;
determining a color value of food in the current pot according to the image of the food in the pot;
determining the food maturity degree in the current pot according to the preset mapping table and the color value of the food in the current pot;
and outputting prompt information according to the current degree of maturity of the food in the pot.
In the embodiment of the invention, preset mapping tables of different food types are configured in advance, each preset mapping table records the mapping relationship between the food color range and the food maturity of the food type, the preset mapping table corresponding to the food type in the current pot is obtained according to the food type in the current pot, the food image in the pot is collected through the second image collecting device 3, the color value of the food in the current pot is determined according to the food image in the pot, the food maturity of the current pot is determined according to the color value of the food in the current pot and the preset mapping table, and therefore prompt information is output according to the food maturity of the current pot to assist a user in cooking.
In an optional implementation mode, the range hood further comprises a casing 1, and a first window is formed in the casing 1; the first image acquisition device 2 comprises a first camera 21, a first transparent protective layer 22 and a first oil-proof protective cover 23, wherein the first oil-proof protective cover 23 is connected to the inner side wall of the machine shell 1 to form a first accommodating cavity; the first camera 21 is accommodated in the first accommodating cavity; the first transparent protection layer 22 is installed on the first window, and the first camera 21 is arranged opposite to the first transparent protection layer 22.
In the embodiment of the invention, the first oil-proof protective cover 23 is arranged, and the first oil-proof protective cover 23 is connected to the inner side wall of the casing 1 to form a first accommodating cavity for accommodating the first camera 21, so that oil smoke behind the first camera 21 is isolated, and the first camera 21 is prevented from being polluted by the oil smoke.
Referring to fig. 2 and 3, in order to fix the first camera 21, the first image capturing device 2 of this embodiment further includes a first fixing bracket, the first fixing bracket is accommodated in the first accommodating cavity, the first fixing bracket includes a first connecting portion 241 and a second connecting portion 242, one end of the first camera 21 is connected to the inner side wall of the housing 1 through the first connecting portion 241, and the other end of the first camera 21 is connected to the inner side wall of the housing 1 through the second connecting portion 242. The two ends of the first camera 21 are respectively fixed by the first connecting part 241 and the second connecting part 242 of the first fixing bracket, so that the first camera 21 can be firmly connected to the housing 1, and the first camera 21 can be used normally.
Preferably, the first window is opened at a side of the housing 1, that is, the first image capturing device 2 is disposed at a side of the housing 1, such as a left side or a right side. In specific application, the first image acquisition device 2 is arranged on the side surface of the casing 1, so that the first camera 21 can shoot images around the range hood, for example, the cooking preparation work of a user, such as vegetable washing and cutting, can be shot. The method comprises the steps of collecting food material images of a user in the processes of washing vegetables and the like so as to perform a subsequent food material identification process.
Referring to fig. 1, 4 and 5, in an optional implementation manner, a second window is further formed on the casing 1 of this embodiment, the second image capturing device 3 includes a second camera 31, a second transparent protective layer 32 and a second oil-proof protective cover 33, and the second oil-proof protective cover 33 is connected to an inner side wall of the casing 1 to form a second accommodating cavity; the second camera 31 is accommodated in the second accommodating cavity; the second transparent protection layer 32 is installed on the second window, and the second camera 31 is opposite to the second transparent protection layer 32. Similarly, similar to the first image acquisition device 2, the second image acquisition device 3 can isolate the external oil smoke of the second camera 31, so as to avoid the oil smoke from polluting the second camera 31, and the second camera 31 can clearly shoot images.
Preferably, the second window is opened on the front surface of the casing 1, that is, the second image capturing device 3 is arranged on the front surface of the casing 1 for shooting the food in the pan. In a specific application, the type of food material obtained after being photographed by the first camera 21 may be used to assist a cooking process, for example, according to the type of the known food material, the food in the pot is photographed by the second camera 31, and the change process of the food material is monitored according to the color of the food material photographed by the second camera 31, specifically, as the cooking progresses, the color of the food material may gradually change, for example, when steak is fried, steak just entering the pot is bright red, as the cooking progresses, steak may gradually change into dark brown, and when brown is deep to a certain degree, steak may be considered to be fried.
In an alternative embodiment, the first transparent protection layer 22 and the second transparent protection layer 32 are both made of transparent glass, the definition of the transparent glass is high, the definition of the shooting can be ensured when the first shooting and the second shooting are protected, and the transparent glass is convenient to clean.
As shown in fig. 4 and fig. 5, in order to fix the second camera 31, the second image capturing device 3 of this embodiment further includes a second fixing bracket, the second fixing bracket is accommodated in the second accommodating cavity, the second fixing bracket includes a third connecting portion 341 and a fourth connecting portion 342, one end of the second camera 31 is connected to the housing 1 through the third connecting portion 341, and the other end of the second camera 31 is connected to the housing 1 through the fourth connecting portion 342. The third connection portion 341 and the fourth connection portion 342 of the second fixing bracket respectively fix two ends of the second camera 31, so that the second camera 31 can be firmly connected to the housing 1, and the normal use of the second camera 31 is ensured.
Please refer to fig. 7, which is a control relationship diagram of another embodiment of the range hood provided by the present invention.
In the embodiment of the present invention, the control device 4 is mounted on the housing 1, and the control device 4 is electrically connected to the first camera 21 and the second camera 31, respectively. The control device 4 is electrically connected to the first camera 21 and the second camera 31, respectively, so that the pictures taken by the first camera 21 and the second camera 31 are stored or processed. In an optional implementation mode, the range hood further comprises a fan control output module 8, a voice output module 5, a key input module 6 and a lighting lamp 7, wherein the fan control output module 8, the voice output module 5, the key input module 6 and the lighting lamp 7 are installed on the machine shell 1 and electrically connected with the control module 4. Through controlling means 4 respectively with fan control output module 8, voice output module 5, button input module 6 and light 7 electricity are connected to each function and the external equipment of control lampblack absorber. For example, if the control device 4 detects that a key of the key input module 6 inputs a power-on command, the fan is turned on, if the control device detects that the key inputs an air volume adjustment, the air volume of the fan is switched, and if the control device detects that the key inputs a command of turning on or off the lighting lamp, the lighting lamp 7 is turned on or off; if the second image acquisition device 3 detects that the user does not stir the food materials for a long time under the condition of high firepower (the second image acquisition device 3 can detect the rotation angle of a knob of the stove and other modes), the voice output module 5 reports the voice to prompt the user to stir the food materials; if the second image acquisition device 3 detects that the food in the pan is burnt and black smoke is emitted, a voice output module 5 is used for reporting voice to prompt the user that the food is being burnt.
In addition, in this embodiment, "output prompt information according to the degree of maturity of food in the current pot," may specifically be to remind the user in a voice broadcast manner, for example, if it is determined that the food in the current pot is cooked, the user may be prompted to finish cooking through the voice output module 5.
In specific implementation, the range hood may further determine whether the user is preparing for cooking, for example, if the picture taken by the first image capturing device 2 is a portrait, and people are present in the picture for a certain period of time, and cooking preparations such as cutting vegetables are performed, the user is determined to be preparing for cooking. In a specific application, the cooking preparation actions of a user, such as meat cutting, vegetable washing and the like, can be shot through the first image acquisition device 2, food materials prepared by the user can be further identified, for example, when the user washes vegetables, the vegetables are large, the range hood can identify the types of the vegetables according to the shapes, colors, sizes and the like of the large vegetables, such as tomatoes, cabbages, balsam pears and the like, when the user cuts vegetables, the shapes of the vegetables can be changed, the range hood can dynamically record the data such as the shapes cut out by the vegetables at the moment, the data are stored after processing, the shape, the size and the like of each food material can be sequentially recorded by the range hood along with the actions of the user, and when the user starts cooking, the data can be called to judge the cooking degree of the food materials.
In the embodiment of the present invention, the control device 4 may be specifically an intelligent board, which is used as a central processing unit of the range hood and is in a central position in the range hood, and can process all the work of the range hood. All data are processed on a local intelligent board, so that the information transmitted by the first image acquisition device 2 and the second image acquisition device 3 can be calculated quickly, reliably and safely, and the video image processing is not influenced by the network speed of a telecom operator; in addition, the intelligent board can detect the initial state of food and accurately judge the type of the food according to the initial state, and the intelligent board can record the change process of the food, such as the process of being chopped and the process of being cooked, and the intelligent board can also track the state of the food in the change process. The intelligent plate has certain cooking auxiliary capacity, such as the cooking degree of food, whether to need to stir and fry, whether dry combustion method and the like.
Accordingly, an embodiment of the present invention further provides a food material identification method, please refer to fig. 8, which is a flowchart illustrating an embodiment of the food material identification method according to the present invention. The food material identification method is applicable to the range hood, is executed by the control device 4 of the range hood, and comprises the following steps:
step S101, receiving a food material image collected by a first image collecting device 2;
step S102, determining the food material color of the food material image according to the food material image;
step S103, finding out all food material samples matched with the food material colors of the food material images from a pre-established database to obtain a first food material sample set; the database stores a plurality of food material samples, and each food material sample comprises the food material color, the food material shape, the food material appearance characteristic and the food material size of a corresponding food material;
step S104, determining the food material shape information, the food material appearance characteristic information and the food material size information of the food material image according to the food material image, finding out all food material samples matched with the food material shape information, the food material appearance characteristic information and the food material size information of the food material image from the first food material sample set, and obtaining a food material identification result.
In an optional implementation manner, the step S104 "determining, according to the food material image, food material shape information, food material shape characteristic information, and food material size information of the food material image, and finding out all food material samples matching the food material shape information, the food material shape characteristic information, and the food material size information of the food material image from the first food material sample set to obtain a food material recognition result", specifically includes:
carrying out gray level processing on the food material image;
performing edge detection on the food material image subjected to gray level processing to obtain food material shape information of the food material image;
finding out all food material samples matched with the food material shape information of the food material images from the first food material sample set to obtain a second food material sample set;
determining the food material appearance characteristic information of the food material image according to the food material image subjected to gray level processing;
finding out all food material samples matched with the food material appearance characteristic information of the food material images from the second food material sample set to obtain a third food material sample set;
determining food material size information of the food material image according to the food material image subjected to gray level processing;
finding out all food material samples matched with the food material size information of the food material images from the third food material sample set to obtain a fourth food material sample set, and obtaining a food material identification result according to the fourth food material sample set.
In the embodiment of the invention, the food material image is subjected to gray level processing, the food material shape information of the food material image is obtained through edge detection, the second food material sample set matched with the food material shape information is found out from the first food material sample set, the third food material sample set matched with the food material appearance characteristic information of the food material image is found out from the second food material sample set, and the fourth food material sample set matched with the food material size information of the food material image is found out from the third food material sample set, so that the food material samples meeting various conditions are screened step by step, repeated matching of the food material samples not meeting the conditions is avoided, and the identification efficiency is improved.
In an optional implementation manner, the performing edge detection on the food material image after the gray processing to obtain the food material shape information of the food material image specifically includes:
determining the gray value of each pixel point in the food material image after graying processing;
acquiring all pixel points of which the difference value between the gray values of two adjacent pixel points is greater than or equal to a preset gray difference threshold value, and correspondingly generating a line graph;
and obtaining the food material shape information of the food material image according to the line graph.
In the specific implementation, because the colors of the food materials generally have a large difference from the colors of the environment in which the food materials are located, for example, when tomatoes are placed on a chopping board, the photographed food material image contains the tomatoes and the chopping board, and pixel points with large gray value difference between adjacent pixel points can be found out, so that the shape information of the tomatoes is obtained. The preset gray difference threshold may be set according to actual requirements, and further details are not described herein.
In an alternative embodiment, each of the food material samples further comprises a food material category (i.e. food material name) of the respective food material; finding out all food material samples matched with the food material size information of the food material image from the third food material sample set to obtain a fourth food material sample set, and obtaining a food material identification result according to the fourth food material sample set, further comprising:
obtaining the number of food material samples of the fourth food material sample set;
when the number of the food material samples in the fourth food material sample set is greater than or equal to 1, outputting the food material types of all the food material samples in the fourth food material sample set;
and when no food material sample exists in the fourth food material sample set, outputting a recognition failure result.
In specific implementation, the food material identification result can be output through a display screen or voice broadcast and other modes. When the number of the food material samples in the fourth food material sample set is multiple, the user can confirm which food material sample is the actual food material, for example, by using a touch screen, a key, or voice control.
The following illustrates a food material identification method provided by an embodiment of the present invention:
for example, identifying the tomatoes, firstly, photographing the food through the first image acquisition device 2, and storing the food as a first picture; then, the color of the first picture is obtained through the first image acquisition device 2, and a food material sample matched with the color is selected from a database, for example, the tomato is red, and red foods comprise tomatoes, pork, apples, cherry tomatoes and hot peppers; then, the first picture is processed with gray scale to generate a second picture (black and white picture); performing edge detection on the second picture to obtain the shape of the current food material, comparing the shape with the shape of the selected red food, and further selecting foods with similar shapes, such as tomatoes approaching to a circle, wherein the circular foods comprise tomatoes, pork, apples and cherry tomatoes; further identifying the appearance characteristics of the food, such as tomatoes having acicular petals, finding out the food with the acicular characteristics from the circular food, wherein the food with the acicular characteristics comprises tomatoes and cherry tomatoes; then, when the size of the food is recognized, if the diameter of tomatoes is generally 5 to 10cm and the diameter of cherry tomatoes is generally 1 to 2cm, the food can be correctly recognized as tomatoes. Finally, after the identification is successful, the identified food is reported to be tomatoes through voice broadcasting.
Accordingly, an embodiment of the present invention further provides a cooking assistance method, please refer to fig. 9, which is a schematic flow chart of an embodiment of the cooking assistance method according to the present invention. The cooking assistance method is applicable to the range hood, is executed by the control device 4 of the range hood, and comprises the following steps:
step S201, acquiring a food material identification result by the food material identification method;
step S202, determining the type of food in the current pot according to the food material identification result;
step S203, acquiring a preset mapping table corresponding to the type of the food in the current pot according to the type of the food in the current pot; wherein the preset mapping table records the mapping relation between the food color range and the food maturity;
step S204, receiving the food image in the pan acquired by the second image acquisition device 3 in real time;
step S205, determining the color value of the food in the current pot according to the food image in the pot;
step S206, determining the food maturity degree in the current pot according to the preset mapping table and the color value of the food in the current pot;
and step S207, outputting prompt information according to the current degree of maturity of the food in the pot.
In the embodiment of the invention, preset mapping tables of different food types are configured in advance, each preset mapping table records the mapping relationship between the food color range and the food maturity of the food type, the preset mapping table corresponding to the food type in the current pot is obtained according to the food type in the current pot, the food image in the pot is collected through the second image collecting device 3, the color value of the food in the current pot is determined according to the food image in the pot, the food maturity of the current pot is determined according to the color value of the food in the current pot and the preset mapping table, and therefore prompt information is output according to the food maturity of the current pot to assist a user in cooking.
In step S207, "outputting a prompt message according to the degree of maturity of the food in the current pot," specifically, the user may be prompted in a voice broadcast manner, for example, if it is determined that the food in the current pot is well done, the user may be prompted to turn over by broadcasting a voice through the voice output module 5.
To sum up, the embodiment of the invention provides a range hood, a food material identification method and a cooking auxiliary method, wherein a food material image acquired by a first image acquisition device 2 is used, the food material color corresponding to the food material image is determined according to the food material image, all food material samples matched with the food material image are found out from a pre-established database to obtain a first food material sample set, then the food material shape information, the food material appearance characteristic information and the food material size information of the food material image are determined according to the food material image, all food material samples matched with the information are found out from the first food material sample set to obtain a food material identification result, and the food material samples meeting conditions are screened according to different conditions, so that the accurate identification of food materials is facilitated, and a good food material identification effect is achieved; in addition, the first food material sample set which accords with the food material colors is found out, and then food material sample screening is further carried out on the first food material sample set, so that repeated matching of food material samples which do not accord with conditions is avoided, and the identification efficiency is improved.
The above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and substitutions can be made without departing from the technical principle of the present invention, and these modifications and substitutions should also be regarded as the protection scope of the present invention.
Claims (10)
1. A range hood is characterized by comprising a first image acquisition device and a control device;
the first image acquisition device is used for acquiring food material images and sending the food material images to the control device;
the control device is used for:
receiving the food material image;
determining the food material color of the food material image according to the food material image;
finding out all food material samples matched with the food material colors of the food material images from a pre-established database to obtain a first food material sample set; the database stores a plurality of food material samples, and each food material sample comprises the food material color, the food material shape, the food material appearance characteristic and the food material size of a corresponding food material;
according to the food material image, determining food material shape information, food material appearance characteristic information and food material size information of the food material image, finding out all food material samples matched with the food material shape information, the food material appearance characteristic information and the food material size information of the food material image from the first food material sample set, and obtaining a food material identification result.
2. The range hood of claim 1, wherein the control device is configured to determine, according to the food material image, food material shape information, food material appearance characteristic information, and food material size information of the food material image, and find out all food material samples matching the food material shape information, food material appearance characteristic information, and food material size information of the food material image from the first food material sample set, and specifically includes:
the control device is used for:
carrying out gray level processing on the food material image;
performing edge detection on the food material image subjected to gray level processing to obtain food material shape information of the food material image;
finding out all food material samples matched with the food material shape information of the food material images from the first food material sample set to obtain a second food material sample set;
determining the food material appearance characteristic information of the food material image according to the food material image subjected to gray level processing;
finding out all food material samples matched with the food material appearance characteristic information of the food material images from the second food material sample set to obtain a third food material sample set;
determining food material size information of the food material image according to the food material image subjected to gray level processing;
finding out all food material samples matched with the food material size information of the food material images from the third food material sample set to obtain a fourth food material sample set, and obtaining a food material identification result according to the fourth food material sample set.
3. A range hood as claimed in claim 1 or 2, further comprising a second image capturing device;
the second image acquisition device is used for acquiring food images in the pan in real time and sending the food images in the pan acquired in real time to the control device;
the control means is further adapted to:
determining the type of food in the current pot according to the food material identification result;
acquiring a preset mapping table corresponding to the type of the food in the current pot according to the type of the food in the current pot; wherein the preset mapping table records the mapping relation between the food color range and the food maturity;
receiving food images in the pan acquired by a second image acquisition device in real time;
determining a color value of food in the current pot according to the image of the food in the pot;
determining the food maturity degree in the current pot according to the preset mapping table and the color value of the food in the current pot;
and outputting prompt information according to the current degree of maturity of the food in the pot.
4. The range hood according to claim 3, further comprising a housing, wherein the housing is provided with a first window and a second window;
the first image acquisition device comprises a first camera, a first transparent protection layer and a first oil-proof protection cover, and the first oil-proof protection cover is connected to the inner side wall of the shell to form a first containing cavity; the first camera is accommodated in the first accommodating cavity; the first transparent protection layer is arranged on the first window, and the first camera is arranged opposite to the first transparent protection layer;
the second image acquisition device comprises a second camera, a second transparent protection layer and a second oil-proof protection cover, and the second oil-proof protection cover is connected to the inner side wall of the shell to form a second containing cavity; the second camera is accommodated in the second accommodating cavity; the second transparent protection layer is arranged on the second window, and the second camera is arranged opposite to the second transparent protection layer;
the control device is electrically connected with the first camera and the second camera respectively.
5. The range hood according to claim 4, wherein the first window is opened on a side surface of the cabinet, and the second window is opened on a front surface of the cabinet.
6. The range hood of claim 4, wherein the first image capture device further comprises:
the first fixing support is accommodated in the first accommodating cavity and comprises a first connecting part and a second connecting part, one end of the first camera is connected to the inner side wall of the shell through the first connecting part, and the other end of the first camera is connected to the inner side wall of the shell through the second connecting part; and
the second fixed bolster, the second fixed bolster holding is in the second holds the intracavity, the second fixed bolster includes third connecting portion and fourth connecting portion, the one end of second camera is passed through third connecting portion connect on the casing, the other end of second camera passes through fourth connecting portion connect on the casing.
7. The range hood according to claim 4, further comprising a fan control output module, a voice output module, a key input module and a lighting lamp, wherein the control device is electrically connected with the fan control output module, the voice output module, the key input module and the lighting lamp, respectively.
8. A food material identification method is characterized by comprising the following steps:
receiving a food material image acquired by a first image acquisition device;
determining the food material color of the food material image according to the food material image;
finding out all food material samples matched with the food material colors of the food material images from a pre-established database to obtain a first food material sample set; the database stores a plurality of food material samples, and each food material sample comprises the food material color, the food material shape, the food material appearance characteristic and the food material size of a corresponding food material;
according to the food material image, determining food material shape information, food material appearance characteristic information and food material size information of the food material image, finding out all food material samples matched with the food material shape information, the food material appearance characteristic information and the food material size information of the food material image from the first food material sample set, and obtaining a food material identification result.
9. The food material identification method of claim 8, wherein the determining of the food material shape information, the food material appearance characteristic information and the food material size information of the food material image according to the food material image, and finding out all food material samples matching the food material shape information, the food material appearance characteristic information and the food material size information of the food material image from the first food material sample set specifically comprise:
carrying out gray level processing on the food material image;
performing edge detection on the food material image subjected to gray level processing to obtain food material shape information of the food material image;
finding out all food material samples matched with the food material shape information of the food material images from the first food material sample set to obtain a second food material sample set;
determining the food material appearance characteristic information of the food material image according to the food material image subjected to gray level processing;
finding out all food material samples matched with the food material appearance characteristic information of the food material images from the second food material sample set to obtain a third food material sample set;
determining food material size information of the food material image according to the food material image subjected to gray level processing;
finding out all food material samples matched with the food material size information of the food material images from the third food material sample set to obtain a fourth food material sample set, and obtaining a food material identification result according to the fourth food material sample set.
10. A cooking assistance method, comprising:
obtaining a food material identification result by the food material identification method according to claim 8 or 9;
determining the type of food in the current pot according to the food material identification result;
acquiring a preset mapping table corresponding to the type of the food in the current pot according to the type of the food in the current pot; wherein the preset mapping table records the mapping relation between the food color range and the food maturity;
receiving food images in the pan acquired by a second image acquisition device in real time;
determining a color value of food in the current pot according to the image of the food in the pot;
determining the food maturity degree in the current pot according to the preset mapping table and the color value of the food in the current pot;
and outputting prompt information according to the current degree of maturity of the food in the pot.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911388231.3A CN113051421A (en) | 2019-12-27 | 2019-12-27 | Range hood, food material identification method and cooking auxiliary method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911388231.3A CN113051421A (en) | 2019-12-27 | 2019-12-27 | Range hood, food material identification method and cooking auxiliary method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113051421A true CN113051421A (en) | 2021-06-29 |
Family
ID=76507668
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911388231.3A Pending CN113051421A (en) | 2019-12-27 | 2019-12-27 | Range hood, food material identification method and cooking auxiliary method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113051421A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113503572A (en) * | 2021-06-30 | 2021-10-15 | 宁波方太厨具有限公司 | Self-cleaning protection system for protecting camera in range hood and cleaning method thereof |
| CN114440276A (en) * | 2022-01-21 | 2022-05-06 | 珠海格力电器股份有限公司 | Automatic control method and system for range hood, storage medium and electronic equipment |
-
2019
- 2019-12-27 CN CN201911388231.3A patent/CN113051421A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113503572A (en) * | 2021-06-30 | 2021-10-15 | 宁波方太厨具有限公司 | Self-cleaning protection system for protecting camera in range hood and cleaning method thereof |
| CN113503572B (en) * | 2021-06-30 | 2023-03-14 | 宁波方太厨具有限公司 | Self-cleaning protection system for protecting camera in range hood and cleaning method thereof |
| CN114440276A (en) * | 2022-01-21 | 2022-05-06 | 珠海格力电器股份有限公司 | Automatic control method and system for range hood, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11229311B2 (en) | Food preparation system | |
| CN100538742C (en) | Food material cooking operation recognition system and the recognition methods of food material cooking operation | |
| US11448403B2 (en) | Cooking appliance with a user interface | |
| CN110488696B (en) | Intelligent dry burning prevention method and system | |
| CN113051421A (en) | Range hood, food material identification method and cooking auxiliary method | |
| CN108679658B (en) | Overflow detection method and device, electronic equipment and intelligent household appliance | |
| EP3685633A1 (en) | Monitoring system and food preparation system | |
| CN110469883B (en) | Multi-sensor-fused cigarette machine rotating speed control method and cigarette machine | |
| CN106326960A (en) | Control method for cooking device and cooking device | |
| CN105911237A (en) | Cooking method and cooking device | |
| CN112394149B (en) | Food material maturity detection prompting method and device and kitchen electric equipment | |
| CN110037534B (en) | Pot body heating method and pot | |
| CN107831692A (en) | Kitchen tools control method, device and electronic equipment | |
| CN109993069A (en) | Kitchen tools detection method and apparatus and system, storage medium | |
| JP7132177B2 (en) | Cooking system and display method of cooking system | |
| CN111594881A (en) | Intelligent gas stove detection and control system based on big data | |
| CN211650375U (en) | Fume exhauster | |
| CN111706885B (en) | Smart home with dry burning recognition function | |
| CN111754736A (en) | Dry combustion method early warning system based on Internet of things | |
| CN111788433B (en) | Interaction module | |
| CN114440276B (en) | Automatic control method and system for range hood, storage medium and electronic equipment | |
| CN112099372A (en) | Menu generation method and device, cooking equipment, mobile terminal and storage medium | |
| CN112861946A (en) | Neural network training method, cooking inspection method and system and intelligent cooking equipment | |
| CN113303665B (en) | Child-friendly food processor control method and system | |
| JP2019201396A (en) | Information processor, information processing method, information processing program, and content distribution system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |