CN113974420A - Intelligent cooking equipment control method and intelligent cooking equipment - Google Patents
Intelligent cooking equipment control method and intelligent cooking equipment Download PDFInfo
- Publication number
- CN113974420A CN113974420A CN202111272347.8A CN202111272347A CN113974420A CN 113974420 A CN113974420 A CN 113974420A CN 202111272347 A CN202111272347 A CN 202111272347A CN 113974420 A CN113974420 A CN 113974420A
- Authority
- CN
- China
- Prior art keywords
- thermal
- intelligent cooking
- thermal image
- thermal images
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000010411 cooking Methods 0.000 title claims abstract description 132
- 238000000034 method Methods 0.000 title claims abstract description 69
- 230000008569 process Effects 0.000 claims abstract description 30
- 238000010438 heat treatment Methods 0.000 claims abstract description 25
- 238000007499 fusion processing Methods 0.000 claims abstract description 13
- 238000003756 stirring Methods 0.000 claims description 58
- 238000010586 diagram Methods 0.000 claims description 19
- 238000003860 storage Methods 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 10
- 239000000463 material Substances 0.000 claims description 7
- 230000000694 effects Effects 0.000 abstract description 7
- 238000009826 distribution Methods 0.000 abstract description 5
- 230000000875 corresponding effect Effects 0.000 description 31
- 238000004590 computer program Methods 0.000 description 11
- 230000001276 controlling effect Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 7
- 238000013473 artificial intelligence Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000004278 EU approved seasoning Substances 0.000 description 1
- 238000005267 amalgamation Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 235000011194 food seasoning agent Nutrition 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J27/00—Cooking-vessels
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J36/00—Parts, details or accessories of cooking-vessels
- A47J36/16—Inserts
- A47J36/165—Stirring devices operatively connected to cooking vessels when being removably inserted inside
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/32—Indexing scheme for image data processing or generation, in general involving image mosaicing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Food Science & Technology (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Radiation Pyrometers (AREA)
- Cookers (AREA)
Abstract
The embodiment of the application provides an intelligent cooking equipment control method and intelligent cooking equipment, and the method comprises the following steps: acquiring a plurality of thermal images in the intelligent cooking equipment, wherein the thermal images are different thermal images generated by the intelligent cooking equipment in the working process, and the thermal images respectively cover different position areas in the intelligent cooking equipment; determining an overlapping area of the plurality of thermal images in a complete thermal image obtained by splicing the plurality of thermal images; performing pixel value fusion processing on the overlapping areas of the plurality of thermal images to obtain corresponding pixel values of all pixel points in the overlapping areas in the complete thermal image; and controlling the intelligent cooking equipment according to the complete thermal image. The inside temperature distribution of intelligent cooking equipment can accurately be known to this application, and then realizes the control to intelligent cooking equipment better, and accurate control guarantees the culinary art effect to the heating time of the inside cooked food of intelligent cooking equipment.
Description
Technical Field
The application relates to the technical field of artificial intelligence, in particular to an intelligent cooking device control method and an intelligent cooking device.
Background
Along with the rapid development of artificial intelligence, more and more intelligent machines are applied to the life of people, for example, an intelligent cooking machine, and a user can finish the automatic cooking process by using the intelligent cooking machine in few participation steps, so that great convenience is brought to cooking of food.
In the cooking process of the existing intelligent cooker, the quality of the final finished dish is generally determined by controlling the weight of food materials, the weight of seasonings, the heating time, the stirring time and the like. However, the most important is still to the assurance of intelligent cooking equipment inside temperature in the intelligence machine of cooking, and in prior art, temperature sensor sets up in intelligent cooking equipment's bottom, can only obtain the temperature of intelligent cooking equipment bottom local area, and then predicts the inside temperature of intelligent cooking equipment, can not accurately control the heat time to the inside cooked food of intelligent cooking equipment, and is relatively poor to the culinary art effect of cooked food.
Disclosure of Invention
A plurality of aspects of this application provide an intelligence cooking equipment control method and intelligent cooking equipment, can accurately know the inside temperature distribution of intelligent cooking equipment, and then realize the control to intelligent cooking equipment better, and accurate control guarantees the culinary art effect to the heating time of the inside cooked food of intelligent cooking equipment.
The embodiment of the application provides an intelligent cooking equipment control method, which comprises the following steps:
acquiring a plurality of thermal images inside intelligent cooking equipment, wherein the thermal images are different thermal images generated by the intelligent cooking equipment in the working process, and the thermal images respectively cover different position areas inside the intelligent cooking equipment;
determining an overlapping area of the plurality of thermal images in a complete thermal image obtained by splicing the plurality of thermal images;
performing pixel value fusion processing on the overlapping areas of the plurality of thermal images to obtain corresponding pixel values of all pixel points in the overlapping areas in the complete thermal image;
and controlling the intelligent cooking equipment according to the complete thermal image.
The embodiment of the present application still provides an intelligence cooking equipment, includes: the device comprises a pot body, a pot cover, a stirring piece, a data acquisition unit and a micro-processing unit;
the pot cover is used for covering the pot body;
the stirring piece is arranged on the pot cover and used for rotating in the pot body so as to stir materials in the pot body;
the data acquisition unit is used for acquiring a plurality of thermal images in the pot body;
the micro-processing unit is arranged on the pot cover and used for: determining overlapping areas of the plurality of thermal images in a complete thermal image obtained by splicing the plurality of thermal images, performing pixel value fusion processing on the overlapping areas of the plurality of thermal images to obtain corresponding pixel values of all pixel points in the overlapping areas in the complete thermal image, and controlling the intelligent cooking equipment according to the complete thermal image
Embodiments of the present application also provide a non-transitory machine-readable storage medium having executable code stored thereon, which when executed by a micro control unit of an intelligent cooking apparatus, causes the micro control unit to perform the intelligent cooking apparatus control method as described above.
In this application embodiment, through gathering the inside a plurality of heating power images of intelligent cooking equipment, confirm the overlap region of a plurality of heating power images in the complete heating power image that a plurality of heating power images of concatenation obtained, and carry out the amalgamation processing of pixel value to the overlap region of a plurality of heating power images, in order to obtain the pixel value that each pixel corresponds in complete heating power image in the overlap region, at this moment, overlap region in the complete heating power image has been fused, according to the complete heating power image after being fused the processing, can accurately know the inside temperature distribution of intelligent cooking equipment, and then can realize the control to intelligent cooking equipment better, accurate control is to the duration of heating of the inside cooked food of intelligent cooking equipment, guarantee the culinary art effect to the cooked food.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic flowchart of a control method of an intelligent cooking apparatus according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of a mosaic of a plurality of thermal images provided by an embodiment of the present application;
fig. 3 is a partial schematic view of a plurality of thermal images provided by an embodiment of the present application during a stitching process;
fig. 4 is a schematic flowchart of a control method of an intelligent cooking apparatus according to an embodiment of the present application;
fig. 5 is a diagram of a specific example of acquiring a complete thermal image according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Along with the rapid development of artificial intelligence, more and more intelligent machines are applied to the life of people, for example, an intelligent cooking machine, and a user can finish the automatic cooking process by using the intelligent cooking machine in few participation steps, so that great convenience is brought to cooking of food.
Aiming at the technical problems that the heating time of dishes in the intelligent cooking equipment cannot be accurately controlled and the cooking effect of the dishes is poor in the prior art, in some embodiments of the application, a plurality of thermal images in the intelligent cooking equipment are collected, overlapping areas of the plurality of thermal images are determined in a complete thermal image obtained by splicing the plurality of thermal images, and the overlapping areas of the plurality of thermal images are subjected to pixel value fusion processing to obtain corresponding pixel values of all pixel points in the complete thermal image in the overlapping areas, at the moment, the overlapping areas in the complete thermal image are fused, the temperature distribution in the intelligent cooking equipment can be accurately known according to the fused complete thermal image, so that the control of the intelligent cooking equipment can be better realized, and the heating time of the dishes in the intelligent cooking equipment can be accurately controlled, ensuring the cooking effect of the dishes.
Fig. 1 is a schematic flowchart of a control method of an intelligent cooking apparatus according to an embodiment of the present application. As shown in fig. 1, the method includes:
In the embodiment of the present application, as an example, an intelligent cooking apparatus includes: the pot body, pot cover, stirring piece, data acquisition unit and microprocessing unit. Wherein, the pot cover is used for covering the pot body. The stirring piece is arranged on the pot cover and used for rotating in the pot body so as to stir materials in the pot body. The data acquisition unit is used for acquiring a plurality of thermal images in the pot body. The microprocessing unit is arranged on the pot cover and is used for: determining overlapping areas of the plurality of thermal images in the complete thermal image obtained by splicing the plurality of thermal images, carrying out pixel value fusion processing on the overlapping areas of the plurality of thermal images to obtain corresponding pixel values of all pixel points in the complete thermal image in the overlapping areas, and controlling the intelligent cooking equipment according to the complete thermal image. The stirring member may be a stirring shovel, but not limited thereto, and may also be a stirring member of other shapes.
It should be understood that traditional temperature sensor sets up in the bottom of intelligent cooking equipment, can't accurately acquire the culinary art state of its inside food material at intelligent cooking equipment culinary art in-process, and considers intelligent cooking equipment at the culinary art in-process, its inside can produce fog, oil smoke etc. if at its inside color camera of installation to gather inside environment image, can receive certain interference.
Based on this, in this application embodiment, can set up the data collection station on the intelligent cooking equipment into infrared collector, and a plurality of heating power images in this application then can obtain through this infrared collector collection. Specifically, for example, the infrared collector may be an infrared camera, but is not limited thereto, and may also be another infrared collector. The specific installation position of this infrared collector can be located between pot cover and the stirring shovel, and in order to guarantee its inside thermal image that can gather the whole pot body, can carry out focusing to this infrared collector when using.
However, the infrared ray has a long wavelength and poor penetration capability, and the stirring piece can shield the infrared ray due to the biggest obstruction in the thermal image acquisition process, so that the infrared collector cannot accurately obtain a complete thermal image in the intelligent cooking equipment. Consequently, this application passes through the in-process of infrared collector collection stirring piece stirring in intelligent cooking equipment, and the inside a plurality of heating power images of intelligent cooking equipment make the collection frequency of a plurality of heating power images and the stirring frequency of stirring piece have and predetermine the corresponding relation at this in-process. For example, the inside of the intelligent cooking device is regarded as a circular structure, and the inside of the intelligent cooking device is equally divided into three fan-shaped structures by taking a round point as a center. At this time, the stirring member rotates in the intelligent cooking device for a circle, three thermal images are collected totally, and the position where the thermal image is collected is the boundary position of the three fan-shaped structures (the three thermal images can be specifically referred to as layer B in fig. 2, in the layer B, the white stripe represents the stirring member, that is, the shielding part during the thermal image collection). That is, the collection frequency of a plurality of thermal images and the stirring frequency of the stirring piece have a preset corresponding relationship as follows: every time the stirring piece rotates 1/3 of the circumference, a thermal image of the interior of the intelligent cooking device is collected.
And 102, determining an overlapping area of the plurality of thermal images in a complete thermal image obtained by splicing the plurality of thermal images.
It should be understood that after the thermal images are acquired inside the intelligent cooking device for multiple times, if the acquired multiple thermal images are spliced, an overlapping area may be generated in the complete thermal image formed after splicing, and the overlapping area may specifically refer to a dark color area in layer C of fig. 2, where the image in layer C is a thermal image formed after splicing two thermal images.
Based on the above, when acquiring a plurality of thermal images inside the intelligent cooking device, when detecting that the stirring part rotates by a set angle (the angle may be 60 °, 90 °, 120 ° or the like), the infrared collector is controlled to acquire one thermal image so as to obtain a plurality of thermal images acquired after the stirring part rotates by a plurality of set angles in sequence. At this time, because the internal structure of the intelligent cooking device and the rotating angle of the stirring piece in the intelligent cooking device are known, the overlapping area of a plurality of thermal images can be determined according to the rotating angle of the stirring piece when different thermal images are collected.
And 103, carrying out pixel value fusion processing on the overlapping areas of the plurality of thermal images to obtain corresponding pixel values of all pixel points in the overlapping areas in the complete thermal image.
After the collected multiple thermal images are spliced, an overlapping area can be generated in the formed complete thermal image, and if the overlapping area is not processed, the finally obtained complete thermal image in the intelligent cooking equipment can be influenced. Therefore, in the embodiment of the present application, the fusion processing of the pixel values is performed on the overlapping areas of the multiple thermal images, and the specific process is as follows:
determining target pixel points in target overlapping regions of the plurality of thermal images, wherein the target overlapping region is any one of the plurality of overlapping regions existing among the plurality of thermal images, and the target pixel point is any one of the pixel points in the target overlapping region.
Pixel values corresponding to the target pixel points are respectively determined in the plurality of thermal images.
And determining a target pixel value corresponding to the target pixel point in the complete thermodynamic diagram according to the plurality of determined pixel values. Specifically, as an example, the target pixel value of the target pixel point in the complete thermodynamic diagram is determined to be an average value of a plurality of pixel values.
The following describes, in combination with the above fusion process, a process for stitching a plurality of thermal images, specifically, the process for stitching a plurality of thermal images includes:
the following process is executed iteratively until the plurality of thermal images are spliced:
and determining a target overlapping area of the first thermal image and the second thermal image in a spliced thermal image obtained by splicing the first thermal image and the second thermal image, wherein the first thermal image and the second thermal image are two of a plurality of thermal images during initial iteration. Wherein the first and second thermal images can be seen in the two left thermal images in the B layer of fig. 2. The thermal image obtained by splicing the first thermal image and the second thermal image is the thermal image in the layer C of fig. 2, and the dark color area of the thermal image in the layer C is the target overlapping area.
For a target pixel point in the target overlapping region, a first angle of the target pixel point relative to a reference pixel point in the target overlapping region is determined, and the reference pixel point is a pixel point of initial overlapping between the first thermal image and the second thermal image. The target pixel point can be referred to as "X" in fig. 3, and the first angle can be referred to as "EOF" in fig. 3.
Determining a corresponding second angle of the target overlapping area in the spliced thermal image; and determining the first angle and the second angle in a coordinate system established by taking the circle center of the spliced thermal image as an origin. Wherein, the second angle can be referred to as < EOG in fig. 3.
And determining the weight value of the target pixel point according to the first angle and the second angle.
In specific implementation, the weight value
And determining the corresponding target pixel values of the target pixel points in the spliced thermal images according to the weighted values of the target pixel points and the pixel values of the target pixel points in the first thermal image and the second thermal image respectively.
In specific implementation, the pixel values of the target pixel point in the first thermal image and the second thermal image respectively correspond to (R)1，G1，B1)，(R2，G2，B2). At this time, the corresponding target pixel value (R) of the target pixel point in the spliced thermal imageresult，Gresult，Bresult) The method specifically comprises the following steps:
Rresult＝R1×W+R2×(1-W)
Gresult＝G1×W+G2×(1-W)
Bresult＝B1×W+B2×(1-W)
of course, the format of the thermal image is not limited to the RGB format, which is just one specific embodiment, and the format of the thermal image may be a single-channel gray-scale image, for example, and the same applies to the above method.
And updating the first thermal image and the second thermal image into a spliced thermal image and a third thermal image, wherein the third thermal image is one of the plurality of thermal images. Wherein the third thermal image can be seen in the rightmost thermal image in layer B of fig. 2.
It should be understood that after the first thermal image and the second thermal image are completely spliced, the thermal image formed by splicing the first thermal image and the second thermal image will be spliced continuously with the third thermal image, and the spliced image can be referred to as the thermal image shown in the D layer in fig. 2.
And 104, controlling the intelligent cooking equipment according to the complete thermal image.
In this step, the complete thermal image refers to the thermal image after the pixel values have been fused, and according to the thermal image, the intelligent cooking device can be controlled, for example, the heating time and the heating temperature of the intelligent cooking device on the internal food materials and the stirring strength of the stirring piece are controlled.
Further, in order to facilitate a user to know the cooking condition inside the intelligent cooking device in real time, the complete thermal image sheet can be converted into a video stream and pushed to a terminal for the user to view. The terminal can be a mobile phone, a tablet computer and the like.
In addition, in the thermal image collection process, the problem that the collected multiple thermal images are not collected in the same batch may occur, that is, the multiple thermal images are not collected within one rotation of the stirring piece, and once the problem occurs, the accuracy of the finally obtained complete thermal image in the intelligent cooking device will be affected. In view of the above, the embodiments of the present application provide a method for solving the problem, which specifically includes:
fig. 4 is a schematic flowchart of a control method of an intelligent cooking apparatus according to an embodiment of the present application, and as shown in fig. 4, the method further includes:
And step 403, determining the matching degree of the feature points extracted from the plurality of thermal images.
In this embodiment, after the feature points in the plurality of thermal images are extracted respectively, the feature points in the plurality of thermal images are compared, and according to the comparison result, the matching degree between the feature points extracted from the plurality of thermal images is determined. For example, feature point extraction is performed on two thermal images, and the number of the same feature points extracted from the two thermal images is determined, and the number of the same feature points can be regarded as the matching degree between the feature points extracted from the multiple thermal images.
And step 404, if the matching degree meets the set conditions, determining that the plurality of thermal images can be spliced.
In specific implementation, if the matching degree between the feature points extracted from the multiple thermal images exceeds a preset threshold, the multiple thermal images can be determined to belong to the thermal images acquired in the same batch, and splicing can be performed. For example, if the number of the same feature points extracted from two thermal images is 5 and the preset threshold is 4, it is proved that the two thermal images belong to the same batch of acquired thermal images, and the two thermal images can be spliced.
Fig. 5 is a diagram of a specific example of acquiring a complete thermal image according to an embodiment of the present application, and as shown in fig. 5, the process of acquiring the complete thermal image is as follows:
stirring by a stirring shovel from an original point;
rotating the cooking device for 1 week, and collecting 3 thermal images of three equal division points in the intelligent cooking device;
calculating the characteristic points of the overlapping areas in the 3 thermal images;
judging the matching degree among the characteristic points of the 3 thermal images, and judging whether the matching degree meets a preset condition;
if the images are consistent, splicing the 3 thermal images together, and fusing the overlapped areas;
and acquiring a complete thermal image inside the cooking device based on the fusion processing result.
Based on the above scheme, the following describes an example of the control process of the intelligent cooking device in the embodiment of the present application.
Scene embodiment one:
the stirring shovel starts to rotate from the initial point in the pot body, and m (m is more than or equal to 2) thermal images are collected through the infrared collector after the stirring shovel rotates for 1 week.
And respectively determining position areas corresponding to the overlapping areas in the m thermodynamic images, extracting feature points in the position areas contained in the m thermodynamic images, and determining the matching degree of the feature points extracted from the m thermodynamic images. At the moment, the matching degree is determined to meet the set conditions, and the m thermal images are spliced.
The splicing process is as follows:
the following process is executed iteratively until the plurality of thermal images are spliced:
determining a target overlapping area of the first thermal image and the second thermal image in a spliced thermal image obtained by splicing the first thermal image and the second thermal image, wherein the first thermal image and the second thermal image are two of a plurality of thermal images during initial iteration;
determining a first angle of a target pixel point relative to a reference pixel point in a target overlapping region for the target pixel point in the target overlapping region, wherein the reference pixel point is a pixel point of initial overlapping between a first thermal image and a second thermal image;
determining a corresponding second angle of the target overlapping area in the spliced thermal image; the first angle and the second angle are determined in a coordinate system established by taking the circle center of the spliced thermal image as an origin;
determining the weight value of the target pixel point according to the first angle and the second angle;
determining a corresponding target pixel value of the target pixel point in the spliced thermal image according to the weight value of the target pixel point and the pixel values of the target pixel point in the first thermal image and the second thermal image respectively;
and updating the first thermal image and the second thermal image into a spliced thermal image and a third thermal image, wherein the third thermal image is one of the m thermal images.
And after splicing is finished, obtaining a complete thermal image in the pot body, and controlling the pot body according to the thermal image.
Scenario example two:
the stirring shovel starts to rotate from the original point in the pot body, and m (m is more than or equal to 2) thermal images are collected through the infrared collector after the stirring shovel rotates for n (n is more than 1) weeks.
And respectively determining position areas corresponding to the overlapping areas in the m thermodynamic images, extracting feature points in the position areas contained in the m thermodynamic images, and determining the matching degree of the feature points extracted from the m thermodynamic images. At this time, it is determined that the matching degree does not meet the set condition, and the m thermal images cannot be spliced.
And acquiring the thermal images in the boiler body again through the infrared acquisition device, and after z thermal images are acquired, determining the matching degree between the characteristic points extracted from the z thermal images again. And repeating the steps until the matching degree meets the set conditions, and then splicing the plurality of thermal images, wherein the splicing process is not repeated. And after splicing is finished, obtaining a complete thermal image in the pot body, and controlling the pot body according to the thermal image.
In conclusion, in the above scheme, by acquiring a plurality of thermal images inside the intelligent cooking device, the overlapping areas of the plurality of thermal images are determined in the complete thermal image obtained by splicing the plurality of thermal images, and the pixel values of the overlapping areas of the plurality of thermal images are fused, so as to obtain the corresponding pixel values of the pixel points in the complete thermal image in the overlapping areas, at this time, the overlapping areas in the complete thermal image are fused, and according to the fused complete thermal image, the temperature distribution inside the intelligent cooking device can be accurately known, so that the control on the intelligent cooking device can be better realized, the heating time of dishes inside the intelligent cooking device is accurately controlled, and the cooking effect of the dishes is ensured. And the position areas corresponding to the overlapping areas are respectively determined in the plurality of thermal images, the characteristic points are extracted from the position areas contained in the plurality of thermal images, the matching degree among the characteristic points extracted from the plurality of thermal images is determined, and if the matching degree meets the set conditions, the plurality of thermal images can be spliced, so that the plurality of thermal images are ensured to be thermal images acquired in the same batch, and a foundation is laid for accurately acquiring complete thermal images subsequently.
The embodiment of the present application further provides an intelligent cooking device, and this intelligent cooking device includes: the pot body, pot cover, stirring piece, data acquisition unit and microprocessing unit. Wherein, the pot cover is used for covering the pot body. The stirring piece is arranged on the pot cover and used for rotating in the pot body so as to stir materials in the pot body. The data acquisition unit is used for acquiring a plurality of thermal images in the pot body. The microprocessing unit is arranged on the pot cover and is used for: determining overlapping areas of the plurality of thermal images in the complete thermal image obtained by splicing the plurality of thermal images, carrying out pixel value fusion processing on the overlapping areas of the plurality of thermal images to obtain corresponding pixel values of all pixel points in the complete thermal image in the overlapping areas, and controlling the intelligent cooking equipment according to the complete thermal image.
In an optional embodiment of the present application, the data collector is an infrared collector.
The embodiment of the present application also provides a non-transitory machine-readable storage medium having executable codes stored thereon, and when the executable codes are executed by a micro control unit of an intelligent cooking apparatus, the micro control unit is caused to execute the above intelligent cooking apparatus control method.
In the embodiment of the present application, the micro control unit may be regarded as a control system of the intelligent cooking device, and may be configured to execute a computer program stored in the memory to control the intelligent cooking device to implement a corresponding function and complete a corresponding action or task. It is worth to be noted that, according to the different implementation forms and scenes of the intelligent cooking device, the functions, actions or tasks to be implemented are different; accordingly, the computer programs stored in the memory may be different, and the micro control unit may control the intelligent cooking apparatus to perform different functions, perform different actions or tasks by executing different computer programs.
In an embodiment of the application, the micro control unit, when executing the computer program in the memory, is adapted to:
acquiring a plurality of thermal images in the intelligent cooking equipment, wherein the thermal images are different thermal images generated by the intelligent cooking equipment in the working process, and the thermal images respectively cover different position areas in the intelligent cooking equipment;
determining an overlapping area of the plurality of thermal images in a complete thermal image obtained by splicing the plurality of thermal images;
performing pixel value fusion processing on the overlapping areas of the plurality of thermal images to obtain corresponding pixel values of all pixel points in the overlapping areas in the complete thermal image;
and controlling the intelligent cooking equipment according to the complete thermal image.
In an optional embodiment, be provided with the stirring piece in the intelligent cooking equipment, be equipped with infrared collector on the intelligent cooking equipment, gather the inside a plurality of heating power images of intelligent cooking equipment, include:
gather the in-process of stirring in intelligent cooking equipment through infrared collector, the inside a plurality of heating power images of intelligent cooking equipment, wherein, the collection frequency of a plurality of heating power images has the preset corresponding relation with the stirring frequency of stirring.
In an optional embodiment, during the process that the stirring piece is stirred in the intelligent cooking device, a plurality of thermal images inside the intelligent cooking device are collected by the infrared collector, and the process comprises the following steps:
when the stirring piece is detected to rotate by a set angle, controlling an infrared collector to collect a thermal image so as to obtain a plurality of thermal images collected after the stirring piece rotates by a plurality of set angles in sequence;
determining an overlap region in a plurality of thermal images, comprising:
and determining the overlapping area of the plurality of thermal images according to the rotation angle of the stirring piece when different thermal images are acquired.
In an alternative embodiment, the process of fusing pixel values for the overlapping regions of the plurality of thermal images includes:
determining target pixel points in target overlapping regions of the plurality of thermal images, wherein the target overlapping region is any one of the plurality of overlapping regions existing among the plurality of thermal images, and the target pixel point is any one of the pixel points in the target overlapping region;
respectively determining pixel values corresponding to the target pixel points in the plurality of thermal images;
and determining a target pixel value corresponding to the target pixel point in the complete thermodynamic diagram according to the plurality of determined pixel values.
In an optional embodiment, determining, according to the determined plurality of pixel values, a target pixel value corresponding to a target pixel point in the complete thermodynamic diagram includes:
and determining that the target pixel value corresponding to the target pixel point in the complete thermodynamic diagram is the average value of the plurality of pixel values.
In an alternative embodiment, the process of stitching a plurality of thermal images includes:
the following process is executed iteratively until the plurality of thermal images are spliced:
determining a target overlapping area of the first thermal image and the second thermal image in a spliced thermal image obtained by splicing the first thermal image and the second thermal image, wherein the first thermal image and the second thermal image are two of a plurality of thermal images during initial iteration;
determining a first angle of a target pixel point relative to a reference pixel point in a target overlapping region for the target pixel point in the target overlapping region, wherein the reference pixel point is a pixel point of initial overlapping between a first thermal image and a second thermal image;
determining a corresponding second angle of the target overlapping area in the spliced thermal image; the first angle and the second angle are determined in a coordinate system established by taking the circle center of the spliced thermal image as an origin;
determining the weight value of the target pixel point according to the first angle and the second angle;
determining a corresponding target pixel value of the target pixel point in the spliced thermal image according to the weight value of the target pixel point and the pixel values of the target pixel point in the first thermal image and the second thermal image respectively;
and updating the first thermal image and the second thermal image into a spliced thermal image and a third thermal image, wherein the third thermal image is one of the plurality of thermal images.
In an optional embodiment, the method further comprises:
determining position areas corresponding to the overlapping areas in the plurality of thermal images respectively;
extracting feature points in a position area contained in each of the plurality of thermal images;
determining the matching degree of the feature points extracted from the plurality of thermal images;
and if the matching degree meets the set conditions, determining that the plurality of thermal images can be spliced.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a micro-control unit of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the micro-control unit of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more micro control units (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. An intelligent cooking device control method is characterized by comprising the following steps:
acquiring a plurality of thermal images inside intelligent cooking equipment, wherein the thermal images are different thermal images generated by the intelligent cooking equipment in the working process, and the thermal images respectively cover different position areas inside the intelligent cooking equipment;
determining an overlapping area of the plurality of thermal images in a complete thermal image obtained by splicing the plurality of thermal images;
performing pixel value fusion processing on the overlapping areas of the plurality of thermal images to obtain corresponding pixel values of all pixel points in the overlapping areas in the complete thermal image;
and controlling the intelligent cooking equipment according to the complete thermal image.
2. The method according to claim 1, wherein a stirring member is arranged in the intelligent cooking device, an infrared collector is arranged on the intelligent cooking device, and the collecting of the plurality of thermal images inside the intelligent cooking device comprises:
through infrared collector gathers the stirring piece is in the in-process of stirring in the intelligent cooking equipment, the inside a plurality of heating power images of intelligent cooking equipment, wherein, it is a plurality of the collection frequency of heating power image with the stirring frequency of stirring piece has the preset corresponding relation.
3. The method according to claim 2, wherein the collecting, by the infrared collector, a plurality of thermal images of the inside of the intelligent cooking device during the stirring of the stirring member in the intelligent cooking device comprises:
when the stirring piece is detected to rotate by a set angle, controlling the infrared collector to collect a thermal image so as to obtain a plurality of thermal images collected after the stirring piece rotates by a plurality of set angles in sequence;
the determining overlapping regions in the plurality of thermal images comprises:
and determining the overlapping area of the plurality of thermal images according to the rotation angle of the stirring piece when different thermal images are collected.
4. The method according to claim 1, wherein the fusing of pixel values of the overlapping regions of the plurality of thermal images comprises:
determining target pixel points in target overlapping regions of the plurality of thermal images, wherein the target overlapping region is any one of a plurality of overlapping regions existing among the plurality of thermal images, and the target pixel points are any one of the pixel points in the target overlapping regions;
determining pixel values corresponding to the target pixel points in the plurality of thermal images respectively;
and determining a target pixel value corresponding to the target pixel point in the complete thermodynamic diagram according to the plurality of determined pixel values.
5. The method of claim 4, wherein determining the target pixel value corresponding to the target pixel point in the complete thermodynamic diagram according to the determined plurality of pixel values comprises:
and determining a target pixel value corresponding to the target pixel point in the complete thermodynamic diagram as an average value of the plurality of pixel values.
6. The method of claim 1, wherein the stitching of the plurality of thermal images comprises:
iteratively performing the following process until the plurality of thermal images are spliced:
determining a target overlapping area of the first thermal image and the second thermal image in a spliced thermal image obtained by splicing the first thermal image and the second thermal image, wherein the first thermal image and the second thermal image are two of the plurality of thermal images during initial iteration;
determining a first angle of a target pixel point in the target overlapping region relative to a reference pixel point in the target overlapping region, wherein the reference pixel point is a pixel point of initial overlapping between the first thermal image and the second thermal image;
determining a corresponding second angle of the target overlapping area in the spliced thermal image; the first angle and the second angle are determined in a coordinate system established by taking the circle center of the spliced thermal image as an origin;
determining a weighted value of the target pixel point according to the first angle and the second angle;
determining a corresponding target pixel value of the target pixel point in the spliced thermal image according to the weight value of the target pixel point and the pixel values of the target pixel point in the first thermal image and the second thermal image respectively;
updating the first thermal image and the second thermal image into the spliced thermal image and a third thermal image, wherein the third thermal image is one of the plurality of thermal images.
7. The method of claim 1, further comprising:
determining a position area corresponding to the overlapping area in the plurality of thermal images respectively;
extracting feature points within the location area included in each of the plurality of thermal images;
determining the matching degree of the feature points extracted from the plurality of thermal images;
and if the matching degree meets the set conditions, determining that the plurality of thermal images can be spliced.
8. An intelligent cooking device, comprising: the device comprises a pot body, a pot cover, a stirring piece, a data acquisition unit and a micro-processing unit;
the pot cover is used for covering the pot body;
the stirring piece is arranged on the pot cover and used for rotating in the pot body so as to stir materials in the pot body;
the data acquisition unit is used for acquiring a plurality of thermal images in the pot body;
the micro-processing unit is arranged on the pot cover and used for: determining overlapping areas of the plurality of thermal images in a complete thermal image obtained by splicing the plurality of thermal images, performing pixel value fusion processing on the overlapping areas of the plurality of thermal images to obtain pixel values corresponding to all pixel points in the overlapping areas in the complete thermal image, and controlling the intelligent cooking equipment according to the complete thermal image.
9. The intelligent cooking device of claim 8, wherein the data collector is an infrared collector.
10. A non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a micro control unit of an intelligent cooking device, causes the micro control unit to perform the intelligent cooking device control method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111272347.8A CN113974420B (en) | 2021-10-29 | 2021-10-29 | Intelligent cooking equipment control method and intelligent cooking equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111272347.8A CN113974420B (en) | 2021-10-29 | 2021-10-29 | Intelligent cooking equipment control method and intelligent cooking equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113974420A true CN113974420A (en) | 2022-01-28 |
| CN113974420B CN113974420B (en) | 2023-02-17 |
Family
ID=79744406
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111272347.8A Active CN113974420B (en) | 2021-10-29 | 2021-10-29 | Intelligent cooking equipment control method and intelligent cooking equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113974420B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0781072A1 (en) * | 1995-12-21 | 1997-06-25 | Whirlpool Europe B.V. | Ir-sensor control in a microwave oven |
| CN105338262A (en) * | 2015-10-09 | 2016-02-17 | 浙江大华技术股份有限公司 | Thermal imaging image processing method and device |
| CN108072058A (en) * | 2016-11-18 | 2018-05-25 | 台湾樱花股份有限公司 | Has the intelligent cooking control system of thermal image |
| CN108445793A (en) * | 2018-02-05 | 2018-08-24 | 江苏大学 | A kind of intelligent machine for stir-frying dishes and its regulation and control method based on image monitoring |
| CN109242773A (en) * | 2018-08-29 | 2019-01-18 | 杭州体光医学科技有限公司 | A kind of joining method and position division methods of thermal infrared images |
| CN110018656A (en) * | 2019-04-04 | 2019-07-16 | 黄山学院 | A kind of intelligent cooking control system and control method having thermal image |
| CN112102169A (en) * | 2020-09-15 | 2020-12-18 | 合肥英睿系统技术有限公司 | Infrared image splicing method and device and storage medium |
| CN112263136A (en) * | 2020-10-30 | 2021-01-26 | 广东美的厨房电器制造有限公司 | Control method and device of cooking equipment, cooking equipment and storage medium |
-
2021
- 2021-10-29 CN CN202111272347.8A patent/CN113974420B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0781072A1 (en) * | 1995-12-21 | 1997-06-25 | Whirlpool Europe B.V. | Ir-sensor control in a microwave oven |
| CN105338262A (en) * | 2015-10-09 | 2016-02-17 | 浙江大华技术股份有限公司 | Thermal imaging image processing method and device |
| CN108072058A (en) * | 2016-11-18 | 2018-05-25 | 台湾樱花股份有限公司 | Has the intelligent cooking control system of thermal image |
| CN108445793A (en) * | 2018-02-05 | 2018-08-24 | 江苏大学 | A kind of intelligent machine for stir-frying dishes and its regulation and control method based on image monitoring |
| CN109242773A (en) * | 2018-08-29 | 2019-01-18 | 杭州体光医学科技有限公司 | A kind of joining method and position division methods of thermal infrared images |
| CN110018656A (en) * | 2019-04-04 | 2019-07-16 | 黄山学院 | A kind of intelligent cooking control system and control method having thermal image |
| CN112102169A (en) * | 2020-09-15 | 2020-12-18 | 合肥英睿系统技术有限公司 | Infrared image splicing method and device and storage medium |
| CN112263136A (en) * | 2020-10-30 | 2021-01-26 | 广东美的厨房电器制造有限公司 | Control method and device of cooking equipment, cooking equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113974420B (en) | 2023-02-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101686926B1 (en) | Image blurring method and apparatus, and electronic device | |
| CN110378946B (en) | Depth map processing method and device and electronic equipment | |
| CN105303514A (en) | Image processing method and apparatus | |
| CN110400338B (en) | Depth map processing method and device and electronic equipment | |
| CN102538980A (en) | Thermal image device and shooting method for thermal image | |
| CN106464811A (en) | System and method for adaptive panoramic image generation | |
| CN104243787A (en) | Photographing method and equipment, and photo management method | |
| JP2016151955A (en) | Image processing apparatus, imaging device, distance measuring device, and image processing method | |
| Alonso et al. | Short and medium-term cloudiness forecasting using remote sensing techniques and sky camera imagery | |
| CN105872363A (en) | Adjustingmethod and adjusting device of human face focusing definition | |
| CN104853094A (en) | Photographing method and device | |
| CN105007413A (en) | Shooting control method and user terminal | |
| CN108335272A (en) | A kind of method and apparatus of shooting picture | |
| CN113674303B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN105049716B (en) | A kind of preview image processing method and user terminal | |
| CN113974420B (en) | Intelligent cooking equipment control method and intelligent cooking equipment | |
| CN105049714B (en) | A kind of character image method for previewing and device | |
| US9995905B2 (en) | Method for creating a camera capture effect from user space in a camera capture system | |
| CN104883495B (en) | A kind of photographic method and device | |
| JP4743773B2 (en) | Edge detection method, apparatus, and program | |
| CN109246355B (en) | Method and device for generating panoramic image by using robot and robot | |
| CN111105351A (en) | Video sequence image splicing method and device | |
| CN104994288A (en) | Shooting method and user terminal | |
| CN112116068B (en) | Method, equipment and medium for splicing all-around images | |
| CN105007410A (en) | Large viewing angle camera control method and user terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |