US20220198772A1 - Food container system with image processing and method - Google Patents
Food container system with image processing and method Download PDFInfo
- Publication number
- US20220198772A1 US20220198772A1 US17/692,334 US202217692334A US2022198772A1 US 20220198772 A1 US20220198772 A1 US 20220198772A1 US 202217692334 A US202217692334 A US 202217692334A US 2022198772 A1 US2022198772 A1 US 2022198772A1
- Authority
- US
- United States
- Prior art keywords
- food
- food item
- pictures
- item
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 235000013305 food Nutrition 0.000 title claims abstract description 158
- 238000000034 method Methods 0.000 title claims abstract description 28
- 238000012545 processing Methods 0.000 title claims description 10
- 238000002360 preparation method Methods 0.000 claims description 12
- 235000016709 nutrition Nutrition 0.000 claims description 11
- 235000014633 carbohydrates Nutrition 0.000 claims description 2
- 150000001720 carbohydrates Chemical class 0.000 claims description 2
- 102000004169 proteins and genes Human genes 0.000 claims description 2
- 108090000623 proteins and genes Proteins 0.000 claims description 2
- 230000000052 comparative effect Effects 0.000 claims 4
- 238000003032 molecular docking Methods 0.000 abstract description 6
- 230000008569 process Effects 0.000 description 6
- 240000008067 Cucumis sativus Species 0.000 description 5
- 239000004615 ingredient Substances 0.000 description 5
- 239000000126 substance Substances 0.000 description 5
- 235000010799 Cucumis sativus var sativus Nutrition 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 4
- 240000002234 Allium sativum Species 0.000 description 3
- 240000000662 Anethum graveolens Species 0.000 description 3
- 235000005911 diet Nutrition 0.000 description 3
- 230000000378 dietary effect Effects 0.000 description 3
- 235000004611 garlic Nutrition 0.000 description 3
- 230000036541 health Effects 0.000 description 3
- 235000014347 soups Nutrition 0.000 description 3
- 238000005303 weighing Methods 0.000 description 3
- 241000234282 Allium Species 0.000 description 2
- 235000002732 Allium cepa var. cepa Nutrition 0.000 description 2
- 235000015155 buttermilk Nutrition 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 235000021221 cucumber soup Nutrition 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 150000003839 salts Chemical class 0.000 description 2
- 235000013618 yogurt Nutrition 0.000 description 2
- 235000009849 Cucumis sativus Nutrition 0.000 description 1
- 208000008589 Obesity Diseases 0.000 description 1
- 244000223014 Syzygium aromaticum Species 0.000 description 1
- 235000016639 Syzygium aromaticum Nutrition 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 235000011970 baked, steamed and boiled puddings Nutrition 0.000 description 1
- 238000009614 chemical analysis method Methods 0.000 description 1
- 235000019219 chocolate Nutrition 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 239000006071 cream Substances 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000005802 health problem Effects 0.000 description 1
- 230000037219 healthy weight Effects 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 235000012054 meals Nutrition 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008450 motivation Effects 0.000 description 1
- NJPPVKZQTLUDBO-UHFFFAOYSA-N novaluron Chemical compound C1=C(Cl)C(OC(F)(F)C(OC(F)(F)F)F)=CC=C1NC(=O)NC(=O)C1=C(F)C=CC=C1F NJPPVKZQTLUDBO-UHFFFAOYSA-N 0.000 description 1
- 235000015097 nutrients Nutrition 0.000 description 1
- 235000020824 obesity Nutrition 0.000 description 1
- 235000002639 sodium chloride Nutrition 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J43/00—Implements for preparing or holding food, not provided for in other groups of this subclass
- A47J43/04—Machines for domestic use not covered elsewhere, e.g. for grinding, mixing, stirring, kneading, emulsifying, whipping or beating foodstuffs, e.g. power-driven
- A47J43/044—Machines for domestic use not covered elsewhere, e.g. for grinding, mixing, stirring, kneading, emulsifying, whipping or beating foodstuffs, e.g. power-driven with tools driven from the top side
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J43/00—Implements for preparing or holding food, not provided for in other groups of this subclass
- A47J43/04—Machines for domestic use not covered elsewhere, e.g. for grinding, mixing, stirring, kneading, emulsifying, whipping or beating foodstuffs, e.g. power-driven
- A47J43/07—Parts or details, e.g. mixing tools, whipping tools
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J36/00—Parts, details or accessories of cooking-vessels
- A47J36/32—Time-controlled igniting mechanisms or alarm devices
- A47J36/321—Time-controlled igniting mechanisms or alarm devices the electronic control being performed over a network, e.g. by means of a handheld device
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J47/00—Kitchen containers, stands or the like, not provided for in other groups of this subclass; Cutting-boards, e.g. for bread
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65D—CONTAINERS FOR STORAGE OR TRANSPORT OF ARTICLES OR MATERIALS, e.g. BAGS, BARRELS, BOTTLES, BOXES, CANS, CARTONS, CRATES, DRUMS, JARS, TANKS, HOPPERS, FORWARDING CONTAINERS; ACCESSORIES, CLOSURES, OR FITTINGS THEREFOR; PACKAGING ELEMENTS; PACKAGES
- B65D25/00—Details of other kinds or types of rigid or semi-rigid containers
- B65D25/54—Inspection openings or windows
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
- F24C7/00—Stoves or ranges heated by electric energy
- F24C7/08—Arrangement or mounting of control or safety devices
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1632—External expansion units, e.g. docking stations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
- G06F16/432—Query formulation
- G06F16/434—Query formulation using image data, e.g. images, photos, pictures taken by a user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
- G06F16/9554—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL] by using bar codes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/01—Customer relationship services
- G06Q30/015—Providing customer assistance, e.g. assisting a customer within a business location or via helpdesk
- G06Q30/016—After-sales
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/147—Details of sensors, e.g. sensor lenses
-
- A—HUMAN NECESSITIES
- A45—HAND OR TRAVELLING ARTICLES
- A45C—PURSES; LUGGAGE; HAND CARRIED BAGS
- A45C11/00—Receptacles for purposes not provided for in groups A45C1/00-A45C9/00
- A45C2011/002—Receptacles for purposes not provided for in groups A45C1/00-A45C9/00 for portable handheld communication devices, e.g. mobile phone, pager, beeper, PDA, smart phone
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65D—CONTAINERS FOR STORAGE OR TRANSPORT OF ARTICLES OR MATERIALS, e.g. BAGS, BARRELS, BOTTLES, BOXES, CANS, CARTONS, CRATES, DRUMS, JARS, TANKS, HOPPERS, FORWARDING CONTAINERS; ACCESSORIES, CLOSURES, OR FITTINGS THEREFOR; PACKAGING ELEMENTS; PACKAGES
- B65D2203/00—Decoration means, markings, information elements, contents indicators
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30128—Food products
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/68—Food, e.g. fruit or vegetables
Abstract
A method and container for providing an enclosure for a food item includes a plurality of grading marks and a docking station to dock an electronic device. Yet further, the system includes a processor configured to take one or more pictures of the food item using the electronic device, transmit the one or more pictures to a cloud, receive recommended recipes for the food item and display the recommended recipes.
Description
- This application is a continuation of U.S. patent application Ser. No. 16/715,373 filed Dec. 16, 2019, which is a continuation of U.S. patent application Ser. No. 14/826,459 filed Aug. 14, 2015, which claims priority to U.S. Provisional Patent Application No. 62/037,142 filed Aug. 14, 2014, all of which are hereby incorporated by reference in their entireties.
- This disclosure relates to food preparation arrangements for example incorporating electrically powered kitchen appliances. Specifically, the disclosure relates to a system for identifying or grading food items and for providing a recipe recommendation to a user.
- Electrically powered kitchen appliances used for food preparation arrangements include, for example:
- 1) stand mixers, by which is meant the kind of kitchen appliance in which a mixing bowl is supported on a pedestal which also supports an electric motor and a drive system including a drive outlet, overhead of the bowl, which permits a planetary mixing action to be imparted to tools suspended into the bowl from the overhead drive outlet;
2) food processors, by which is meant the kind of kitchen appliance in which a rotary tool mounted in the base a bowl is driven from beneath the bowl by means of a suitable drive coupling from an electric motor; and
3) blenders, which are similar to food processors, and indeed are often combined therewith, and which include a tool, mounted in a goblet or similar vessel, driven from beneath the goblet. - Such kitchen appliances are well known and established, and each form has respective capabilities; the more expensive stand mixers usually being capable of performing a wider range of functions than the food processors and blenders. Nevertheless, in respect of all such appliances, there is a continuous drive to increase their functionality and general usefulness without substantially increasing their price to the end-user. It is, for example, generally the case that when any of the foregoing appliances is used, the users want to know recipes that they may prepare based on food items available with them. Further, the users may want to access additional information about the available food items including nutritional content, freshness, quality and weight of the food items. The users may want additional information as they are becoming more interested in eating healthier food due to increase in obesity and other health problems. However, it is often difficult for people to follow dietary plans or access recipes that are recommended by doctors to achieve health goals like losing weight or to maintain a healthy weight. This is difficult for users as it is not easy to determine nutritional content of food and often the dietary plans forces them to reduce intake of well-liked food and to increase intake of disliked food, which decreases the user's motivation to strictly follow the dietary plans.
- It is an aspect of the disclosure to provide a system, which is able to quickly and efficiently recommend recipes for the respective: food items available with users. Further, the system may provide additional information including nutritional content, freshness, quality and weight of the food items. The recipes may be recommended such that they are healthy and liked by the users. More specifically, the solution to the problems is provided in a way such that it mitigates the existing problems around the implementation of such solutions within the home environment for appliances.
- According to the disclosure, a food-grading device comprises a container for providing an enclosure for a food item, wherein the surface of the container includes a plurality of grading marks. The food-grading device further includes a docking station arranged to dock an electronic device facing the enclosures. Yet further, the food-
grading device 100 includes a processor configured to take one or more pictures of thefood item 104 using theelectronic device 110, transmit the one or more pictures to acloud 202, receive recommended recipes for thefood item 104 and display the recommended recipes. Further still, the food-grading device 100 includes a local memory configured to store one or more pictures and additional information of thefood item 104, and recommended recipes for thefood item 104. - According to another embodiment of the disclosure, the
cloud 202 comprising afood database 206 storing pictures and recipes of a plurality of food items and a food-grading service unit 204. The food-grading service unit 204 is configured to receive one or more pictures of thefood item 104 from the food-grading device 100, process the one or more pictures of thefood item 104 to determine the type and quantity of thefood item 104, select one or more recipes based on thetype food item 104 and transmit information about the one or more recommended recipes. - Technical advantages of particular embodiments include the automatic detection of food items and their quantity based on pictures of the food items. Further, recommending recipes for detected food items and sending instructions to one or more kitchen appliances for the recommended recipes. Accordingly, the functionality of the kitchen appliances may be increased.
- Other technical advantages will be readily apparent to one skilled in the art from the following figures, descriptions and claims. Moreover, while specific advantages have been enumerated above, various embodiments may include all, some or none of the enumerated advantages.
- In order that the disclosure may be clearly understood and readily carried into effect, certain embodiments thereof will now be described, by way of example only, with reference to the accompanying drawings. The invention extends to any novel aspects or features described and/or illustrated herein.
- The invention extends to methods and/or apparatus substantially as herein described and/or as illustrated with reference to the accompanying drawings.
- The invention also provides a computer program and a computer program product for carrying out any of the methods described herein and/or for embodying any of the apparatus features described herein, and a computer readable medium having stored thereon a program for carrying out any of the methods described herein and/or for embodying any of the apparatus features described herein.
- Any apparatus feature as described herein may also be provided as a method feature, and vice versa. As used herein, means plus function features may be expressed alternatively in terms of their corresponding structure, such as a suitably programmed processor and associated memory.
- Any feature in one aspect of the invention may be applied to other aspects of the invention, in any appropriate combination. In particular, method aspects may be applied to apparatus aspects, and vice versa. Furthermore, any, some and/or all features in one aspect can be applied to any, some and/or all features in any other aspect, in any appropriate combination.
- It should also be appreciated that particular combinations of the various features described and defined in any aspects of the invention can be implemented and/or supplied and/or used independently.
- In this specification the word ‘or’ can be interpreted in the exclusive or inclusive sense unless stated otherwise.
- Furthermore, features implemented in hardware may generally be implemented in software, and vice versa. Any reference to software and hardware features herein should be construed accordingly.
- The invention extends to a container, image processing, apparatus or method as described herein and/or substantially as illustrated with reference to the accompanying drawings.
- The present invention is now described, purely by way of example, with reference to the accompanying diagrammatic drawings, in which:
-
FIG. 1A andFIG. 1B show, in perspective view, one example of a food-grading device according to the present disclosure; -
FIG. 1C shows a side view of the food-grading device andFIG. 1D shows a top view of the food-grading device according to the present disclosure; -
FIG. 2 is a block diagram of a food-grading system according to the present disclosure; -
FIG. 3 is a flowchart of a method for grading food and recommending recipes according to the present disclosure; and -
FIG. 4 illustrates a user interface of a mobile phone application that receives and displays recipes according to the present disclosure. - Referring now to
FIGS. 1A and 1B , in which corresponding features carry the same reference numbers, a food-grading device 100 comprises acontainer 102 which acts as an enclosure for afood item 104; for example an apple. Thecontainer 102 may include one ormore grading marks 106 on the surface of thecontainer 102. Each mark in thegrading marks 106 may be an etch, a depression, a raised portion, a print, or any other structure that is clearly observable from inside and outside of thecontainer 102. The grading marks 106 indicate a unit of measurement, such as centimeters or inches. - The
container 102 is cube shaped. However, thecontainer 102 may be of any other suitable shape such as spherical, cuboid or conical. Thecontainer 102 may have one or more openings that allow a user to place thefood item 104 inside thecontainer 102. For example, the one or more side faces of thecontainer 102 may open as a gate or the top face of thecontainer 102 may be a lid that can be lifted of thecontainer 102 to allow the user to place thefood item 104 in thecontainer 102. Further, thecontainer 102 may be transparent such that thefood item 104 is visible to the user at all times. Yet further, thecontainer 102 is may be hermitically sealable which ensures that no extraneous elements enter thecontainer 102 when thefood item 104 is placed in thecontainer 102. Thecontainer 102 may further be dishwasher-safe which makes it easy for the user to clean the food-grading device 100. The food-grading device 100 may also include a weighing scale to determine weight of thefood item 104. Further, the food-grading device 100 may include one or more sensors to perform chemical analysis of thefood item 104. For example, the food-grading device 100 may include an odor sensor that is used to capture the odor given out by thefood item 104 and detect chemical nature of odor molecules. The food-grading device 100 may also be connected to a network that includes, but is not limited to, the Internet, LAN, MAN, WAN, or the like. - Further, the food-
grading device 100 may include adocking station 108, which is used to dock anelectronic device 110 including a smart phone, a tablet, a camera, a 3D scanner and a barcode scanner. In the example shown inFIG. 1B , a smartphone is docked on thedocking station 108. Thedocking station 108 may electronically connect the food-grading device 100 and theelectronic device 110 using one or more ports available on thedocking station 108. When activated, theelectronic device 110 is configured to take pictures of thefood item 104. For example, the user may use controls (not shown) available on the outer surface of the food-grading device 100 to instruct the food-grading device 100 to initiate taking pictures using theelectronic device 110. Alternatively, the user may directly activate theelectronic device 110 to take pictures. - Further, the
container 102 may have a turntable installed on the bottom face of the food-grading device 100. The turntable rotates thefood item 104 at a predefined rate, which allows theelectronic device 110 to take multiple pictures of thefood item 104 from various angles. This helps in grading thefood item 104 more accurately. Further, a 3D digital model of thefood item 104 may be created using the multiple pictures of thefood item 104 taken from various angles.FIG. 1C shows a front view of the food-grading device 100 andFIG. 1D shows a top view of the food-grading device 100. -
FIG. 2 shows a block diagram of a food-grading system 200 according to the present disclosure. The food-grading system 200 includes the food-grading device 100 connected to acloud 202. Examples of clouds are Windows Azure™, Amazon EC2™, Bungee Connect™, Google App Engine™, and others. Thecloud 202 includes afood database 206 includes details of a plurality of food items including names, pictures and contents of the food items. - Further, the
cloud 202 includes a food-grading service unit 204, which receives one or more pictures for thefood item 104 from the food-grading device 100. Further, the food-grading service unit 204 may also receive additional information including weight and chemical analysis report of thefood item 104. Thereafter, the food-grading service unit 204 performs image processing on the one or more pictures obtained to determine the type and quantity of thefood item 104. Image processing may include matching the one or more pictures of thefood item 104 with the pictures available in thefood database 206. For example, the food-grading service unit 204 may determine that thefood item 104 is an apple based on image processing. Then, the food-grading service unit 204 may determine weight of thefood item 104. Accordingly, the food-grading service unit 204 first calculates the volume occupied by thefood item 104. To accomplish this, the food-grading service unit 204 obtains the position of the grading marks 106 with respect to thefood item 104 from image processing. The grading marks 106 in the one or more pictures help the estimation of the site of thefood item 104 in each of the three dimensions, which is used to estimate the volume of thefood item 104. Alternatively, a 3D digital model of thefood item 104 may be created using the one or more pictures of thefood item 104; thereafter, voxels (volume pixel) may be used to determine the volume of thefood item 104. Once volume is known, the food-grading service unit 204 may access thefood database 206 to obtain density of thefood item 104 based on the type of thefood item 104 detected. Thereafter, equation (1) below may be used to determine weight of thefood item 104. -
- Alternatively, the food-
grading device 100 includes a weighing scale and sends the weight information to the food-grading service unit 204. - Moreover, the
food database 206 may include nutritional information about each food item in thefood database 206. For example, the nutritional information and other information including pictures in thefood database 206 may advantageously be obtained on an ad-hoc basis depending on requirements of the food-grading service unit 204 from databases such as the U.S. Department of Agriculture (USDA) nutrient database. The nutritional information may indicate the amount of calories, carbohydrates, protein, etc. of various food items. Yet further, thefood database 206 includes recipes for various food items. Therefore, the food-grading service unit 204 may provide the nutritional information about the detectedfood item 104 to the user and recommend recipes for the detectedfood item 104. This information may be sent to one or more of theelectronic device 110 and akitchen appliance 208 such that user may use these devices to access the information. This is explained in further detail in conjunction withFIG. 4 below. For example, the user may use atouch display 210 on the kitchen appliance 208 (the food processor 208) to access the information. The user may optionally use thetouch display 210 to provide feedback to the food-grading service unit 204. Further, the food-grading service unit 204 may send instructions to be followed by thekitchen appliance 208 for various recipes. Yet further, the user may have a user account with the food-grading service unit 204. Accordingly, the food-grading service unit 204 may recommend recipes to balance meals of the user and to help the user achieve predetermined health goals, or on feedback received from the user or from other users. The food-grading service unit 204 may also determine quality of thefood item 104 and share this information with the user. - In another embodiment, image processing may detect a barcode, which may directly provide information about type and quantity of the
food item 104. - The food-
grading service unit 204 also comprises a processor, coupled to thefood database 206 for generating the recipe recommendations based on the detectedfood item 104. - In an exemplary embodiment, a user may place a cucumber in the food-
grading device 100. When thecloud 202 detects the food item as cucumber, it recommends multiple recipes to the user. The recommended recipes may be displayed on thetouch display 210 of thefood processor 208. The user may select a recipe titled “Cold Cucumber Soup Recipe” from the recommended recipes. Thereafter, thetouch display 210 displays full details (shown below) of the selected recipe including name of the recipe, number of serves, preparation time, electronic appliances required, ingredients required and the method steps. - Preparation time: 10 minutes
Can be made with these appliances: Food processor - 1. Cucumbers 2 (about 750 g)
- 3. Fresh garlic 01 to 1 clove
4. Spring onions, white 6 - 6. Dill 1 tbsp
7. Buttermilk or cream 200 g - 1. Peel and cut the cucumber length ways then scoop out the seeds.
2. Attach the knife blade to the food processor,
3. Place the cucumber, salt, garlic, spring onion, yoghurt and dill into the food processor bowl.
4. Process to a smooth puree on high speed.
5. To finish the soup attach the whisk.
6. Switch the machine to low speed and whisk in the buttermilk.
7. Traditionally we serve such soup in a bowl set over a bowl of ice. To finish the soup top with some chopped dill and garlic croutons, - Further, the
cloud 202 may send instructions to thefood processor 208 to program thefood processor 208 based on the method steps. For example, thefood processor 208 is programmed to process at high speed at fourth method step and then switch to low speed at sixth method step. - As the user performs the tasks corresponding to each method step, the user may select the corresponding method steps one-by-one on the
touch display 210. Therefore, when user selects the method step four on thetouch display 210, thefood processor 208 automatically processes the food at high speed. Similarly, when the user selects the method step six on thetouch display 210, thefood processor 208 automatically processes the food at low speed. - It will be appreciated that, in such circumstances, the
cloud 202 may send instructions to two or more kitchen appliances including food processors, blenders mixers, fryers and ovens, to program each appliance based on the method steps of a selected recipe. - In another embodiment, the
touch display 210 also allows user to order one or more ingredients for a selected recipe from an online store. - Referring now to
FIG. 3 , is a flowchart 300 illustrating method for grading food and recommending recipes according to the present disclosure. Atstep 302, a user places thefood item 104 in thecontainer 102. Then atstep 304, the food-grading device 100 takes pictures of thefood item 104 using theelectronic device 110. The user may instruct theelectronic device 110 to initiate taking pictures if thefood item 104. Alternatively, the user may use controls (not shown) available on the food-grading device 100 to instruct the food-grading device 100 to initiate taking pictures using theelectronic device 110. Further, the food-grading device 100 may determine weight using weighing scale available in the food-grading device 100. Yet further, the food-grading device 100 may perform chemical analysis of thefood item 104 using available sensors that employ food-safe chemical analysis techniques. - Next at
step 306, the food-grading device 100 transmits the one or more pictures and optionally the additional information obtained to thecloud 202. The additional information includes weight and chemical analysis report of thefood item 104. The food-grading device 100 may directly transmit the one or more pictures and additional information to thecloud 202 through a connection to a computer network such as the Internet. Alternatively, the food-grading device 100 may instruct theelectronic device 110 to transmit the one or more pictures and additional information to thecloud 202. - Optionally, to avoid unnecessary processing, the food-
grading device 100 may consult a local memory (not shown) of thefood grading device 100 before transmitting (or instructing theelectronic device 110 to transmit) the one or more pictures or the additional information to thecloud 202. If the one or more pictures or the additional information corresponds to data already stored in the local memory of thegrading device 100, the food-grading device will not transmit it to thecloud 202, but instead display nutritional information of thefood item 104 and one or more stored recipes stored on the local memory of thegrading device 100. Alternatively, instead of displaying the information, the food-grading device 100 could send the information to one or both of theelectronic device 110 and thekitchen appliance 208. The data stored on the local memory of thegrading device 100 could be previously sent to or received from thecloud 202 in a previous query and stored by the local memory of thegrading device 100, or it could be preloaded data for common foodstuffs. - Once the
cloud 202 receives the one or more pictures and additional information sent by the food-grading device 100, the food-grading service unit 204 available on thecloud 202 processes the one or more pictures and additional information atstep 308. This includes performing image processing to determine the type and quantity of thefood item 104. Further, the food-grading service unit 204 may use thefood database 206 available with thecloud 202 to obtain nutritional information of thefood item 104 and one or more recipes to recommend to the user. Further, the user may have an account with the food-grading service unit 204. Therefore, the food-grading service unit 204 may select recipes based on user preferences, health goals, availability of ingredients etc. Thereafter, the food-grading service unit 204 sends the information to one or more of the food-grading device 100, theelectronic device 110 and thekitchen appliance 208. Finally, atstep 310, the information is received at the user's end. The information may also include instructions to program thekitchen appliance 208 for various recipes. - Referring now to
FIG. 4 , is auser interface 400 of a mobile phone application installed on theelectronic device 110 according to an embodiment of the present disclosure. The mobile phone application receives and displays recipes recommended by the food-grading service unit 204. In an example embodiment, the mobile phone application displays arecipe 402 for “chocolate steamed pudding”, Therecipe 402 includes apicture 404 of the final dish. Further, therecipe 402 includes information andinstructions 406 for preparing the recipe. The user may view further details using an “Ingredients”tab 408 and a “Method”tab 410. The mobile phone application may also allow the user to send theinstructions 406 to one or more kitchen appliances to program the kitchen appliances for the selected recipe. The instructions 606 from theelectronic device 110 may be sent to the one or more kitchen appliances via thecloud 202 or directly using a short-range wireless communication protocol such as Bluetooth, Zigbee, Infrared, Wi-Fi etc. Theuser interface 400 may optionally allow the user to send feedback to the food-grading service unit 204. - It will be understood that the present invention has been described above purely by way of example, and modifications of detail can be made within the scope of the invention.
- Each feature disclosed in the description, and (where appropriate) the claims and drawings may be provided independently or in any appropriate combination.
- Reference numerals appearing in the claims are by way of illustration only and shall have no limiting effect on the scope of the claims.
Claims (10)
1. A method comprising:
obtaining image data relating to a food item;
delivering the data to a processor, and using the processor to carry out the steps of:
obtaining information relating to the weight of the food item by;
calculating the volume occupied by the food item based on one or more pictures of the food item;
accessing the food database to obtain the density of the food item based on the type of food item; and
obtaining the weight of the food item from the density of the food item, and the volume of the food item;
comparing the image data with comparative data in a database;
determining, based on the comparative data and the additional information, the type and quantity of the food item;
selecting, based on the determined type and quantity, a recipe relating to the food item, the recipe comprising food preparation information relating to a plurality of food preparation steps, including configuration information relating to at least one food preparation step to be carried out by a kitchen appliance;
providing the configuration information to the kitchen appliance; and
configuring the kitchen appliance to carry out the at least one food preparation step based on the configuration information.
2. Image processing apparatus comprising:
an electronic device arranged to obtain image data relating to a food item, and to deliver the data to a processor, the processor being configured to:
obtain information relating to the weight of the food item by;
calculating the volume occupied by the food item based on one or more pictures of the food item;
accessing the food database to obtain the density of the food item based on the type of food item; and
obtaining the weight of the food item from the density of the food item, and the volume of the food item;
compare the image data with comparative data in a database;
determine, based on the comparative data and the additional information, a type and quantity of the food item;
select, based on the determined type and quantity, a recipe relating to the food item, the recipe comprising food preparation information relating to a plurality of food preparation steps, including configuration information for operating a kitchen appliance to carry out at least one of the plurality of food preparation steps;
provide the configuration information to the kitchen appliance; and
configure the kitchen appliance to carry out the at least one food preparation step based on the configuration information.
3. Apparatus as claimed in claim 2 , in which the processor is configured to provide the recipe to the electronic device.
4. Apparatus as claimed in claim 2 , in which the recipe comprises instructions for programming a kitchen appliance.
5. Apparatus as claimed in claim 2 , in which the image data comprises a bar code providing information about the type and/or quantity of the food item.
6. Apparatus as claimed in claim 2 in which:
the database comprises pictures and recipes relating to a plurality of food items; and
the processor is configured to:
select one or more recipes based on the type of the food item: and transmit information about the one or more recommended recipes to the electronic device.
7. Apparatus as claimed in claim 6 in which the image data comprises one or more pictures and wherein the processor is configured to match the one or more pictures of the food item with the pictures of the plurality of food items available in the database.
8. Apparatus as claimed in claim 2 , wherein the processor is configured to obtain information relating to the weight of the food item by:
calculating the volume occupied by the food item based on grading marks visible in the one or more pictures of the food item, wherein the grading marks indicate the size of the food item in each or any of the three dimensions.
9. Apparatus as claimed in claim 2 , wherein the processor is configured to calculate the volume occupied by the food item by creating a 3D digital model of the food item based on the one or more pictures of the food item and then enumerating the number of voxels in the 3D digital model to determine volume of the food item.
10. Apparatus as claimed in claim 2 , wherein the food database further includes nutritional information about a plurality of food items, wherein the nutritional information includes amount of calories, carbohydrates and protein in each food item in the plurality of food items.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/692,334 US20220198772A1 (en) | 2014-08-14 | 2022-03-11 | Food container system with image processing and method |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201462037142P | 2014-08-14 | 2014-08-14 | |
US14/826,459 US10635921B2 (en) | 2014-08-14 | 2015-08-14 | Food container system and method |
US16/715,373 US20200117932A1 (en) | 2014-08-14 | 2019-12-16 | Food Container System And Method |
US17/692,334 US20220198772A1 (en) | 2014-08-14 | 2022-03-11 | Food container system with image processing and method |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/715,373 Continuation US20200117932A1 (en) | 2014-08-14 | 2019-12-16 | Food Container System And Method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20220198772A1 true US20220198772A1 (en) | 2022-06-23 |
Family
ID=54258681
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/826,459 Active 2036-02-16 US10635921B2 (en) | 2014-08-14 | 2015-08-14 | Food container system and method |
US16/715,373 Abandoned US20200117932A1 (en) | 2014-08-14 | 2019-12-16 | Food Container System And Method |
US17/692,334 Abandoned US20220198772A1 (en) | 2014-08-14 | 2022-03-11 | Food container system with image processing and method |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/826,459 Active 2036-02-16 US10635921B2 (en) | 2014-08-14 | 2015-08-14 | Food container system and method |
US16/715,373 Abandoned US20200117932A1 (en) | 2014-08-14 | 2019-12-16 | Food Container System And Method |
Country Status (3)
Country | Link |
---|---|
US (3) | US10635921B2 (en) |
GB (2) | GB2586112B (en) |
HK (1) | HK1223255A1 (en) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2519805B (en) | 2013-10-31 | 2018-08-01 | Kenwood Ltd | Food-processing tools and food-processing appliances incorporating same |
CN108700306B (en) * | 2016-04-20 | 2021-09-14 | 德国福维克控股公司 | System for making at least one food item and method for operating a related system |
EP3489639A1 (en) * | 2017-11-23 | 2019-05-29 | Koninklijke Philips N.V. | Cooking assistance device and method |
US11216643B1 (en) * | 2018-04-05 | 2022-01-04 | Objectvideo Labs, Llc | Monitoring of pet feeding with video |
US11631010B1 (en) | 2019-01-06 | 2023-04-18 | Adaptics Limited | System and method for use with connected kitchen appliances |
EP3731131A1 (en) * | 2019-04-24 | 2020-10-28 | BSH Hausgeräte GmbH | Apparatus for assisted cooking |
EP3730011A1 (en) | 2019-04-24 | 2020-10-28 | Vorwerk & Co. Interholding GmbH | Method for nutrition control, kitchen appliance and system for preparing food |
CN112693717B (en) * | 2020-12-11 | 2022-09-27 | 惠州市美盛隆科技有限公司 | Tank structure with detection function |
CN113254786B (en) * | 2021-06-22 | 2021-09-17 | 湖南轻悦健康管理有限公司 | Big data-based diet information pushing method and system and cloud platform |
EP4129131A1 (en) * | 2021-08-04 | 2023-02-08 | BSH Hausgeräte GmbH | Extractor unit for a kitchen appliance |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140263640A1 (en) * | 2013-03-13 | 2014-09-18 | Ryder C. Heit | Method and Apparatus for Cooking Using Coded Information Associated with Food Packaging |
Family Cites Families (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3902182A (en) * | 1973-10-18 | 1975-08-26 | Lars Evert Bernhard Hillborg | Process and device for determining photographically dimensions of persons and objects |
US4753031A (en) * | 1987-06-25 | 1988-06-28 | Owen H Drew | Catch and release fish data recording system |
JP2001208463A (en) * | 2000-01-25 | 2001-08-03 | Osami Tsutsui | Refrigerator giving instruction on cooking menu |
US20020009016A1 (en) * | 2000-07-21 | 2002-01-24 | Bruce Ancona | Apparatus and method for a smart kitchen appliance |
US6746029B2 (en) * | 2002-02-15 | 2004-06-08 | Taiwan Semiconductor Manufacturing Co., Ltd | Photograph vehicle |
US7454390B2 (en) | 2004-03-17 | 2008-11-18 | Panasonic Corporation | Ingredient cooking-operation recognition system and computer-readable recording medium which is recorded with ingredient cooking-operation recognition program |
US20060196879A1 (en) * | 2005-03-03 | 2006-09-07 | Rubbermaid Commercial Products, Llc | Transparent trash receptacle |
US8145854B1 (en) * | 2006-06-08 | 2012-03-27 | Rusty Shawn Lee | Method and apparatus for controlling automated food preparation systems |
DE102006044365A1 (en) * | 2006-09-20 | 2008-04-03 | Mettler-Toledo (Albstadt) Gmbh | Automatic recognition device |
WO2009031996A2 (en) * | 2007-09-06 | 2009-03-12 | Tyco Healthcare Group Lp | Touchless auto-drop sharps container |
US7999688B2 (en) * | 2007-12-20 | 2011-08-16 | Intel-Ge Care Innovations Llc | Embedded assessment of refuse for activity monitoring |
US20090167506A1 (en) * | 2008-01-02 | 2009-07-02 | Defond Components Limited | Method of controlling networked kitchen appliances |
US8419433B2 (en) | 2008-04-15 | 2013-04-16 | International Business Machines Corporation | Monitoring recipe preparation using interactive cooking device |
JP2010061382A (en) * | 2008-09-03 | 2010-03-18 | Nikon Corp | Automatic recipe creation apparatus and program |
CN101751512A (en) | 2008-12-04 | 2010-06-23 | 深圳富泰宏精密工业有限公司 | Recipe management system applied to communication device and method |
US9320388B2 (en) * | 2009-11-15 | 2016-04-26 | Legupro Ab | Liquid movement and control within a container for food preparation |
DE102009058258A1 (en) * | 2009-12-10 | 2011-06-16 | Vorwerk & Co. Interholding Gmbh | food processor |
EP2638325B1 (en) * | 2010-11-12 | 2015-03-11 | Convotherm Elektrogeräte GmbH | A cooking device, and a procedure for cooking food |
US20120179665A1 (en) * | 2011-01-07 | 2012-07-12 | Access Business Group International Llc | Health monitoring system |
US8746063B1 (en) * | 2011-01-24 | 2014-06-10 | Anthony Paul Lumpkin | Apparatus and method for utilizing food residue |
US8779735B2 (en) * | 2011-03-15 | 2014-07-15 | Infineon Technologies Ag | System and method for an overcurrent protection and interface circuit between an energy source and a load |
US20130111936A1 (en) * | 2011-11-09 | 2013-05-09 | Timothy John Olson | Refrigerator With Individualized Locking Drawers |
US9538880B2 (en) * | 2012-05-09 | 2017-01-10 | Convotherm Elektrogeraete Gmbh | Optical quality control system |
CN102680414B (en) * | 2012-05-30 | 2014-06-25 | 华中农业大学 | Automatic grading device for red globe grapes based on machine vision and method thereof |
US20140063180A1 (en) * | 2012-09-06 | 2014-03-06 | Bby Solutions, Inc. | Connected food scale system and method |
US20140104385A1 (en) | 2012-10-16 | 2014-04-17 | Sony Network Entertainment International Llc | Method and apparatus for determining information associated with a food product |
JP6007091B2 (en) * | 2012-12-07 | 2016-10-12 | 株式会社Pfu | Imaging platform and imaging system |
KR102026730B1 (en) * | 2013-04-08 | 2019-09-30 | 엘지전자 주식회사 | Refrigerator |
US9089059B1 (en) * | 2013-09-19 | 2015-07-21 | Amazon Technologies, Inc. | Device packaging system |
WO2015157229A1 (en) * | 2014-04-07 | 2015-10-15 | Rober Mark Braxton | Microwave oven with thermal imaging temperature display and control |
-
2015
- 2015-08-14 GB GB2018140.0A patent/GB2586112B/en not_active Expired - Fee Related
- 2015-08-14 US US14/826,459 patent/US10635921B2/en active Active
- 2015-08-14 GB GB1514521.2A patent/GB2531414B/en not_active Expired - Fee Related
-
2016
- 2016-10-08 HK HK16111668.0A patent/HK1223255A1/en unknown
-
2019
- 2019-12-16 US US16/715,373 patent/US20200117932A1/en not_active Abandoned
-
2022
- 2022-03-11 US US17/692,334 patent/US20220198772A1/en not_active Abandoned
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140263640A1 (en) * | 2013-03-13 | 2014-09-18 | Ryder C. Heit | Method and Apparatus for Cooking Using Coded Information Associated with Food Packaging |
Also Published As
Publication number | Publication date |
---|---|
GB2586112A (en) | 2021-02-03 |
GB2586112B (en) | 2021-07-07 |
HK1223255A1 (en) | 2017-07-28 |
GB2531414A (en) | 2016-04-20 |
US20200117932A1 (en) | 2020-04-16 |
GB201514521D0 (en) | 2015-09-30 |
GB202018140D0 (en) | 2020-12-30 |
US20160048720A1 (en) | 2016-02-18 |
US10635921B2 (en) | 2020-04-28 |
GB2531414B (en) | 2021-01-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20220198772A1 (en) | Food container system with image processing and method | |
US20210152649A1 (en) | Intelligent blending system | |
US10441112B1 (en) | Food preparation system and method using a scale that allows and stores modifications to recipes based on a measured change to one of its ingredients | |
US10692394B2 (en) | Systems, articles and methods related to providing customized cooking instruction | |
US10320582B1 (en) | System for smart spoilage alerts | |
WO2016145430A1 (en) | Display system for blending systems | |
US20170035249A1 (en) | Ingredient scale system and methods | |
EP4084656A1 (en) | Systems and methods for automated cooking | |
CN105225182A (en) | A kind of dietary recommendations continued method and device thereof | |
WO2007051049A2 (en) | Systems and methods to facilitate food and drink preparation | |
CN105741211A (en) | Dietary data processing method, device and equipment | |
JP2016173658A (en) | Health management system, health management method, program, and recording medium | |
US9524409B1 (en) | Food storage container tag system and method | |
US11062620B1 (en) | System and method for processing simple ingredients in a recipe | |
KR101732128B1 (en) | System for providing nutrition diet menu using network | |
US11468487B2 (en) | Apparatus and method of communicating information about a packaged food product | |
US11879769B2 (en) | Automatic cooking assistance device and method to provide cooking instructions | |
US20190066534A1 (en) | System and method for container identification and recipe alignment based on volume | |
US10987643B1 (en) | System and method for providing appliance operations associated with a recipe | |
US10990418B1 (en) | System and method for providing appliance operation instructions and data entry during the preparation of a recipe | |
US20230063302A1 (en) | Data processing apparatus and data processing method | |
WO2021024299A1 (en) | Food product generating system | |
KR20220119602A (en) | Information processing devices, information processing methods |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |