CN110686458A

CN110686458A - Method for preparing food in a domestic refrigeration appliance and domestic refrigeration appliance

Info

Publication number: CN110686458A
Application number: CN201910589444.6A
Authority: CN
Inventors: D·乌尔班; M·克瑙夫
Original assignee: BSH Home Appliances Co Ltd
Current assignee: BSH Home Appliances Co Ltd; BSH Hausgeraete GmbH
Priority date: 2018-07-04
Filing date: 2019-07-02
Publication date: 2020-01-14
Also published as: DE102018211048A1

Abstract

The invention relates to a method for preparing food in a domestic refrigeration device, wherein the food in a receiving chamber of the domestic refrigeration device is detected by at least one image detection unit of the domestic refrigeration device and, depending on this, it is determined whether the food is stored in sufficient quantity, wherein at least one separate first placement device is placed into the receiving chamber in a location-specific manner, a position for determining the orientation of the first food is predefined for a user by the first placement device, wherein the first food can be placed on the first placement device in the receiving chamber, and at least one image acquired by the image detection unit is evaluated whether the first placement device is detected and, if the first placement device is identified in the image, the quantity of the first food present on the first placement device is determined. The invention also relates to a domestic refrigeration appliance.

Description

Method for preparing food in a domestic refrigeration appliance and domestic refrigeration appliance

Technical Field

The invention relates to a method for preparing food in a domestic refrigeration appliance. The food in the receiving chamber of the domestic refrigeration appliance is detected by at least one image detection unit of the domestic refrigeration appliance. From which it is determined whether the food is stored in sufficient quantity. Furthermore, the invention also relates to a domestic refrigeration device.

Background

This is known, for example, from DE 112016003769T 5. There is also known a cooling appliance with a camera, by means of which certain food products, for example milk in a milk box, can be monitored. When only one third of the milk in the box is still available, the system can order the milk in another box. Further, the system can learn reaction times and automatically adapt to event triggers.

DE 102016209441 a1 discloses a method and a device for detecting the contents of a storage compartment of a domestic refrigeration appliance, wherein the detection is carried out by a scanning device, which may be a camera or an RFID transmitter/receiver.

A drawback that can be seen in the known systems is that the loading of the receiving chamber for the food product can be varied and different. This may be user dependent and meet individual needs. This makes detection by a camera, which is usually positioned in a stationary manner on the domestic refrigeration appliance, difficult, in particular partially even not sufficiently accurate.

Disclosure of Invention

The object of the present invention is to provide a method and a domestic refrigerator, in which or by means of which food can be detected more accurately.

This object is achieved by a method and a domestic refrigeration appliance according to the independent claims.

One aspect of the invention relates to a method for preparing food in a domestic refrigeration appliance. In the method, the food product in the receiving chamber of the domestic refrigeration appliance is detected by at least one image detection unit of the domestic refrigeration appliance when the food product is present in the receiving chamber of the domestic refrigeration appliance. From which it is determined whether the food product is stored in a sufficient amount in the receiving chamber. At least one separate first placement device is provided in the receiving chamber. A first food product can be placed on the first placement device in the receiving chamber. The position of the first food item for the determination is predetermined by the placement device for the determination of the orientation of the user. At least one image acquired by the image detection unit is evaluated as to whether the first placement device is detected in relation to the image. If this is the case and a first placement device is identified in the image, the amount of the first food item on the first placement device is determined. This method of operation thus enables the detection of a specific food item, which can be detected in an improved manner in relation to the image, to be carried out more precisely from now on, since a predetermined region of the orientation in the receiving chamber is predetermined by the placement device on which the first food item is to be placed, in order to then be able to identify the first food item in an improved manner and then also to determine the quantity of the first food item which is already present in an improved manner.

In particular, in the method, the first placement device is searched for in the image evaluation in an intelligent manner in the image processing sequence, since the first placement device can be said to be the main trigger for the fact that the food to be determined can then be recognized in the receiving chamber in an improved manner, in particular with regard to the quantity of the food. The placement device is thus a component of the object, which on the one hand generates a prompt for the user that he should place his specific food product, which corresponds to the placement device, on the placement device in an exact and thus orientation-specific manner, in order that the quantity of the first food product present on the placement device can then also be determined in a targeted manner by the electronic system of the domestic refrigeration appliance and whether a sufficient quantity is available. On the other hand, the placement device specifies for the electronic system a search criterion for the graphical evaluation, which should be searched in the image in a first step. The placement device then also determines a defined position in the image and thus a limited region in which the food item located on the placement device is then clearly identified as a food item which is intended to be stored on the placement device in accordance with the regulations, so that the determination of the quantity of the food item can then also be focused very precisely in the orientation in the image.

In an advantageous manner, it is provided that a region larger than an occupation region occupied by the first placement device and a first food item possibly placed thereon is detected by the image detection unit, wherein the occupation region is identified when evaluating at least one image, and only the image part with the occupation region in the image is taken into account for determining the quantity of the first food item. This allows a faster and more accurate identification of the first food item to be evaluated, since irrespective of the further image region of the image, further food items are also placed in the further image region or, if necessary, such first food items are also additionally placed again. Thereby improving the clarity of the description with respect to the amount of the first food product. In particular, the placement device is already predefined for the user where he should deposit his corresponding food, so that the quantity monitoring can be carried out electronically. If the user knows that one such first food item is placed next to the placement device, the user realizes and then also knows to disregard this amount area of the first food item not placed on the placement device when electronically detecting and evaluating the amount of the first food item in relation to the image.

The operating method provides the user with a versatile and variable system for filling at least a first food product, so that the quantity of the first food product can then also be determined automatically electronically. Furthermore, in such an image evaluation, by observing only the image part with the occupied area, the area with the directly adjacent further food items detected in the image is concealed and, if necessary, a false combination can be at least significantly reduced. Focusing on evaluating only the image portion also improves the determination accuracy and description accuracy.

Preferably, when a first depositing device is identified in the image, only the quantity of the first food product located on the first depositing device is determined, so that a description can be made as to whether the first food product is stored in a sufficient quantity. Further food products in the receiving space next to the placement device, in particular also the first food product not placed on the placement device, are not taken into account.

It is preferably provided that the first placement device is positionally variably positionable in the receiving chamber and that, when the image is evaluated, the first placement device is recognized independently of its position if it is detected in the image. This is a further very advantageous embodiment, since the first placement device can also be positioned in the receiving chamber variably and variously by the user. A user-customized positioning of the first placement device can thereby be carried out, so that, for example, additional food products can be positioned in the receiving chamber according to the user-customized wishes. This may for example be the case in view of easy access to the food and/or arranging food products belonging to a class in the receiving chamber as grouped as possible. Depending on the size and/or quantity, the first placement device can be positioned in a particular position in the receiving chamber. However, by this being recognized in the acquired image, it is also possible to easily take into account the variable positioning and still recognize the placement device in the image and then determine the amount of the first food product placed on the placement device.

It can also be provided that the first placement device must always be arranged in the same position in the receiving chamber, so that an accurate detection by the camera can be achieved. This can also be provided in particular in the case of a stationary mounting of the individual first placement devices of the objects in the receiving space.

It may also be provided that the placement position and/or the placement orientation for the first food item is predetermined in a defined manner by the first placement device, so that the first food items are placed on the first placement device in a defined and ordered manner. By means of this predetermination, a fixed position pattern of the first food item on the placement device is achieved, so that the first food item is recognized in an improved manner, in particular with regard to the quantity of the first food item present on the first placement device. It can be provided that the placement position and/or the placement orientation are predefined by a shape-specific recess in the first placement device. The recess can be configured, for example, as a groove, so that the elongate first food product can be positioned positionally accurately on the groove. The counting of the first food products is simplified because there is no undesired masking of each other, which cannot be solved at the time of image evaluation. The placement orientation can also be predetermined by the line of defense of the recess. In this way, in the case of the elongate first food product, when, for example, the trough-like recess is oriented in the depth direction of the domestic refrigeration device, the first food product is then placed correspondingly positioned on the placement device and can then also be arranged side by side and/or one above the other in alignment and thus oriented in the same direction.

A further example of a recess that determines the placement position and/or placement orientation may be an angular or circular groove. For example, a bottle with a round bottom can then be placed into the recess, or a carton, which can be realized, for example, in a so-called tetra pack, can be placed fixedly into the recess. Further trays, such as fruit trays or the like, can then be placed in a positionally accurate and positionally fixed manner.

Preferably, provision is made for a second food product, which is different from the first food product, to be able to be placed in the receiving chamber on a separate second placement device, by means of which a position for determining the orientation of the second food product is predefined for the user. At least one image acquired by the image detection unit is evaluated as to whether a second depositing device is detected and, if in particular only a second depositing device is identified in the image, the quantity of a second food product present on the second depositing device is determined. This is a further particularly advantageous embodiment, since in this way, in at least one image, both the first placement device and, if appropriate, the second placement device, which is independent of the first placement device and is arranged in the receiving space at a distance from the first placement device in terms of orientation, can be identified virtually simultaneously. This makes it possible to carry out individual quantity determinations with respect to the different food products, i.e. the first food product and the second food product, which are respectively assigned to and positioned in a defined manner on the placement device. This makes it possible to carry out a very rapid quantity determination process for a plurality of different food products on the one hand and this also takes place in particular independently of one another.

It can also be provided that two different food products can be placed on at least one placement device in a defined manner and that the two food products can be detected in a defined manner by means of the image detection unit.

Different food products can generally be derived in that the containers containing said food products are determined differently in terms of shape and/or size. The difference may however also be derived in addition or instead by the colour of the container and/or an external marking, for example a printed layer or a label or the like. In this case, the size and/or shape of the containers may also be the same.

This may for example be a beverage container.

It can be provided that, when a specific shape and/or size of the beverage container is recognized, an exact order for replenishment of the beverage is made, in particular from a specific manufacturer. It may also be provided that a supplementary order for a further beverage of a specific manufacturer is made when a specific beverage container containing a beverage of that manufacturer is identified, or that a supplementary order for a further variety of an identified beverage is made from that manufacturer. It may also be provided that, upon identification of a beverage container with a beverage of a specific manufacturer, a supplementary order for this type of beverage is made from a different manufacturer.

It is particularly advantageous that the two food products, although different, belong to one category for preparing beverages or dishes. This may for example be the case if the two food products, both liquid, can produce a mixed beverage. It is always particularly advantageous here if information is available about the amount of the two food products, so that the amount of at least one of the two food products which is too small can be determined individually if necessary. This can be done individually and as well as possible. Also in the case of other food products, such as fruit or other condiments, such as sauce containers, cream containers or the like, the amount can be determined and a decision can be made individually whether an order is required.

The information about the quantity of the at least one food product can be used, in particular, whether a prompt is output to a user and/or whether a replenishment order for the food product is automatically generated, in particular electronically or visually, by an, in particular electronic, management system of the machine of the domestic refrigeration appliance. This allows at least one user of the domestic refrigeration device to react intelligently to the demand and to carry out corresponding processing in accordance with the demand.

Preferably, provision can be made for the user to specify a provider for the food product, which can be stored, for example, in particular by the user. The predetermined provider is then contacted by the electronic management system during the automatic replenishment order in order to carry out a replenishment order authorization. The user-personalized recommendations can thus be taken into account by the electronic system. For example, very short provisioning times can be used here. Special conditions may also be required which are authorized by the user if necessary.

In an alternative embodiment, it can be provided that the electronic management system searches for a provision time and/or a price for the food to be placed in order via the communication network, in particular the internet, and selects a provider as a function of the provision time and/or the price. It may be provided that in such an embodiment, when the electronic management system searches for a provider, the user is notified of the preference. It may be provided that when the user confirms the proposal of the selected provider, the provider is contacted, in particular to make a supplementary order delegate. This may be achieved, for example, by communication via an input unit, such as a portable communication transmission device, such as a mobile communication device or a tablet computer. Since the user carries such a device with a high probability, the procedure for the subscription replenishment decision can also be quickly informed and, if necessary, ultimately decided by the user. Thereby minimizing delays associated with the replenishment order.

Preferably, a need for a supplementary order is generated as an indication and/or a need for exchanging the food item concerned from a further storage region of the domestic refrigeration appliance to the first placement device, if appropriate to the first placement device and/or the second placement device, is generated as an indication. It may be provided that the first food product is placed on the first placement device in a first amount and is placed in the storage area in a further amount, but not on the first placement device. It may be provided that the storage area is not detectable by the image detection unit in relation to the image. Such loading may be provided for space reasons, for example. It can also be provided that the loading is known by the user, in order to position the first food product to be consumed on the first depositing device if necessary, for example, preferentially with respect to the consumption time point, and to make it correspondingly identifiable in this connection. Furthermore, such a loading of the receiving chamber may also be known by the user when the amount of the first food product on the first placement device may result in a suggested replenishment order and the user may already know that the replenishment order requires a certain duration, the first food product still being sufficiently present before the amount of the first food product of the replenishment order is reached. This is particularly advantageous when the threshold value for the amount of triggering a supplementary subscription is predefined to be relatively low or is automatically determined by the system.

In an advantageous embodiment, provision can be made for the following to be checked for generating the reminder: whether the detected quantity of food product is below a first characteristic threshold value and/or a second characteristic threshold value characterizing the quantity of food product to be evaluated. In addition or alternatively, it can be provided that a replenishment order is made when the detected quantity of food is below a first and/or a second characteristic threshold value which is characteristic of the quantity of food to be evaluated. The evaluation program is made more accurate by the characteristic threshold values, in particular at least two different characteristic threshold values. It is possible to detect more precisely at which time a number of food items placed on the placement device are taken out and if necessary how many such food items are needed in the future.

It is particularly advantageous here if, starting from the start of the quantity of food product on the placement device, at least the first characteristic threshold value and the second characteristic threshold value are lowered, only a prompt and/or replenishment order is made. This makes it possible to more precisely trace back the removal intervals of the food items and thus also to determine when and by how much the food items ordered for replenishment should be replenished. The embodiment is also particularly advantageous in that the description accuracy is increased in the case of particular foodstuffs which are difficult to carry out, in particular in the manner of image-dependent detection and quantity evaluation, and in that erroneous evaluations are reduced to a minimum in the case of small fluctuations which may be around one of the characteristic thresholds. In particular, the two characteristic thresholds are determined numerically differently from one another in such a way that a sufficient quantity scale exists between the characteristic thresholds in order to be able to detect the removal quantity of the food product on the associated placement device accurately in relation to the image and then to be able to recognize the drop below the two characteristic thresholds accurately, in order to thus also determine the exact quantity of the removed food product.

In particular, a further prompt and/or supplementary subscription is only generated if the two characteristic thresholds are exceeded and then undershot again after the first prompt and/or supplementary subscription.

Preferably, a flexible mat is inserted as a first placement device into the receiving chamber. The mat is on the one hand of relatively flat construction, so that the loading space above the mat is not undesirably limited. Even when the device is placed in the embodiment, for example, on a shelf in the receiving chamber of a household refrigerator, then sufficient volume remains above the mat, so that even larger quantities of food disposed on the mat accordingly can be placed. Furthermore, the flexible mat suitably and robustly improves the environmental conditions in the receiving chamber, in particular also with respect to temperature and/or humidity values. In addition, the pad can also be easily manipulated by the user for easy removal and easy loading with food. Furthermore, the mat can be easily recognized also in the image on the basis of its configuration and thus enables an easy and accurate recognition. Furthermore, the flat structure of the mat enables more accurate identification of the food items placed on the mat, also when the food items are arranged in a stack. The detection right at the front side may then be particularly advantageous, since the food is exposed to the front side.

It is preferably provided that the mat indicates the placement of the first food item for the user depending on its size and/or its color, so that the user, when looking at the receiving chamber, very quickly and intuitively recognizes which food item he places in which position in the receiving chamber, i.e. on a specific placement device, so that it can then be easily recognized by the electronic management system.

Provision may also be made for the food item to be identified as the first food item in the evaluation of the image on the basis of the size and/or the colour of the mat.

In an advantageous embodiment, it is stored in the electronic management system which first food product should be placed on said first placement device. It is thereby also possible to automatically know that the food item is the first food item when the first placement device is identified during the image evaluation and a food item is placed on the first placement device. In this case, the actual recognition by the image evaluation no longer has to be performed compulsorily: where the first food product is present. It is assumed that this is also actually the first food product.

In an advantageous embodiment, it can be provided that the correspondence stored in the electronic management system can be changed individually by the user. The placement device can thus be used individually by the user, with different food products being placed and identified on the first placement device for different situations according to the user's subscription and storage in the electronic management system.

The same applies in an advantageous manner to the at least one second placement device as described in the preceding embodiments for the first placement device.

It may be provided that the placement device (in particular if it is configured as a mat) is configured with a non-slip surface on the underside and/or on the upper side. This can improve the prevention of undesired slipping of the entire placement device in the receiving chamber. It is likewise possible to avoid undesirable slipping of the food placed on the placement device.

A further aspect of the invention relates to a domestic refrigerator having a housing in which at least one receiving chamber for food is formed. The domestic refrigeration appliance has at least one detection unit, in particular an image detection unit, for detecting at least one partial region of the receiving chamber, in particular in image-dependent manner. The domestic refrigerator also has at least one placement device for food. The domestic refrigeration appliance also has an electronic management system. The domestic refrigeration device is preferably designed to carry out the method according to the preceding aspect or any one of the advantageous embodiments of the aspects. The method is carried out in particular by a domestic refrigeration appliance.

The domestic refrigeration appliance can also have a shelf or door shelf or drawer as a further storage area. These are parts of the object that are independent of the placement device. The placement device may for example be placed on a grid. The image detection unit may for example be a camera. The domestic refrigeration appliance may be a refrigerator or freezer appliance or a combination refrigerator and freezer appliance. The domestic refrigerator is used for storing and preserving food. The receiving compartment may be a refrigeration compartment or a freezing compartment.

In a further advantageous embodiment, the electronic management system of the domestic refrigeration appliance is configured as a machine self-learning system. This means that the learning effect on loading food and/or generating reminders and/or replenishment orders is also evaluated and taken into account for future scenarios. The machine Learning process may be implemented, for example, by so-called Deep Learning. As an algorithm, for example, CNN (Convolutional Neural Network) can be used. The detection unit may be designed as an image detection unit. However, the detection unit can also be designed, for example, as an RFID (Radio-frequency identification) unit.

In an advantageous manner, it can be provided that the first characteristic threshold value and/or the second characteristic threshold value is/are automatically adjusted by the electronic management system. This may for example be related to the food product which is placed on the placement device and which should be detected. However, this may also or instead be taken into account, for example, in connection with a scenario detected in the past with regard to loading and removal of the food product on the respective placement device.

By means of the at least one placement device of the object, in particular a defined and controllable environment, in which a specific food item should be placed location-specifically (lokal), in order that the food item can be evaluated in an improved manner with regard to the electronic evaluation, in particular with regard to the identification and determination of the currently present quantity, in particular when image-dependent detection and evaluation is carried out. This prevents, in particular, undesired overlapping or masking of one another or the presence of further food products, thereby limiting the detection.

In order to increase the recognition accuracy and thus the reliability, it can be provided that in a specific embodiment no exact value determination of the quantity, for example no exact number determination of the beverage containers present, for example bottles, is carried out, but rather, depending on the situation, for example, a binary response to whether a specific threshold value, in particular a threshold value range, is undershot by the electronic control system is predefined. The threshold value may be the characteristic threshold value mentioned advantageously.

By the expressions "above", "below", "front", "rear", "horizontal", "vertical", "depth direction", "width direction", "height direction" are meant the positions and orientations found in conventional use and conventional arrangement of appliances.

Further features of the invention emerge from the claims, the figures and the description of the figures. The features and feature combinations mentioned above in the description and those mentioned below in the description of the figures and/or shown in the figures individually can be used not only in the respectively given combination but also in further combinations or individually without departing from the framework of the invention. Thus, the embodiments of the invention which are not shown and described in detail in the figures, but which can be learned and produced by individual feature combinations from the described embodiments, are also considered to be encompassed and disclosed. The embodiments and feature combinations described below are also considered to be disclosed, which do not have all the features of the originally expressed independent claims.

Drawings

Embodiments of the present invention are described in detail below with reference to schematic drawings. In the drawings:

fig. 1 shows a schematic view of an embodiment of a domestic refrigeration appliance according to the invention; and

fig. 2 shows a simplified schematic diagram of the quantity of food product on a placement device of a domestic refrigerator as a function of time profile.

In the figures, identical or functionally identical elements are provided with the same reference signs.

Detailed Description

Fig. 1 shows a schematic illustration of a domestic refrigeration device 1, which is designed for storing and preserving food. The domestic refrigerator 1 can be a refrigerator or freezer or a combination refrigerator and freezer.

The domestic refrigerator 1 has a housing 2. A receiving chamber 3 for food products is constructed in the housing 2. The receiving chamber 3 may in particular be a refrigerating compartment. The receiving chamber 3 is delimited by the walls of the inner container 4. The inner container 4 has a loading opening on the front side in the depth direction (z direction). The loading opening can be closed by a door 5 of the domestic refrigeration appliance 1. The door 5 is swingably disposed in the housing 2.

Fig. 1 shows the door 5 in the open state. It can be provided that, for example, at least one door shelf 7 is arranged on an inner side 6 of the door 5, which inner side faces the receiving space 3 in the closed state of the door 5. The door shelf 7 is configured to receive food items. For example, a receptacle for a beverage container 7a, for example a bottle, is provided. The door shelf 7 is thus arranged on the door side.

Furthermore, the domestic refrigeration device 1 has a grid 8 arranged in the receiving chamber 3 on the housing side. In the exemplary embodiment, it is provided that the first compartment 8 and the second compartment 9 are arranged on the housing side in the receiving space 3. The plate-shaped panels are arranged at different heights in the height direction (y direction). Furthermore, a further food receiving container 10 can also be provided, which is, for example, a box or a drawer that can be pushed into the receiving space 3 and pulled out of it in the depth direction on the housing side.

The domestic refrigeration appliance 1 also has at least one detection unit 11. The detection unit 11 is in particular an image detection unit, for example a camera. The position and number of the detection units 11 are merely to be understood as exemplary in fig. 1. The detection unit 11 can be arranged in particular on the door 5, in particular on the inner side 6, so that the receiving chamber 3 can be detected when the door 5 is closed. It is achieved in particular that the detection region of the detection unit 11, which is in particular designed as an image detection unit, is oriented such that, for example, regions of the receiving chamber 3 which extend, viewed from the top, up to the lower grid 9 can be detected.

It may be provided that the camera is provided with a fisheye lens so that such a large-angle shooting can be performed.

The domestic refrigeration appliance 1 also preferably has a control unit 12. The control unit 12 is in particular a component of an electronic management system 13 of the domestic refrigeration appliance 1. At least one detection unit 11 is also in particular a component of said electronic management unit or of said electronic management system 13. The electronic management system 13 may also be located, for example, at least partially outside the household refrigeration appliance 1, for example, in a Cloud computer (Cloud).

It can be provided that the information of the detection unit 11 is transmitted to the control unit 12 and processed and evaluated there. In one embodiment, the functionality of the control unit 12 may also be transferred to a cloud computer.

In the exemplary embodiment shown, the domestic refrigeration appliance 1 has a separate first placement device 14 for the objects. The first placement device 14 is a component of the object that is independent of the door shelf 7 and the

panels

8, 9. In an embodiment, the first placement device 14 is configured as a pad. The first placement device is positioned in the embodiment on the upper side of the grid 8 and on the right in the receiving chamber 3 when viewed from the front side. The first placement device 14 is arranged on the grating 8 in particular in a manner that can be removed without damage. The first placement device can thus also be arranged in a multiplicity of ways by the user at different further locations in the receiving chamber 3. As can be seen here, the first placement device 14 is arranged in the front region of the panel 8, viewed in the depth direction, in particular such that no further objects can be arranged in front of the first placement device 14, viewed in the depth direction. This allows particularly accurate detection of the first food product placed on the first placement device 14 by the detection unit 11 in the closed state of the door 5.

The placement device 14 is designed in such a way that, in particular, also by means of a predefined correspondence, a specific first food item is to be placed on it. This correspondence can also be predefined in a personalized manner, in particular by the user. This can be achieved, for example, by corresponding programming or storage. This correspondence is then stored in the electronic management system 13, in particular in the control unit 12. The correspondence can also be changed in an advantageous manner, user-specifically.

The first depositing device 14 also visually represents the part of the object to the user who should position the corresponding first food product relevant thereto in the receiving chamber 3 at the part in order to be able to be detected and evaluated in a targeted manner by the detection unit 11. In the exemplary embodiment shown, a beverage container 15, in particular a bottle, is provided as a first food product on the first placement device 14. In particular, the first placement device 14 also preferably specifies a corresponding placement position and/or placement orientation of the first food product 15. In the embodiment shown here, the beverage containers 15 are arranged side by side and stacked and positioned flat. The beverage container is here preferably stored with the container bottom towards the loading opening. The amount of the first food product on the first placement device 14 can thereby be detected in a particularly advantageous manner and accurately by means of the detection unit 11. In particular, provision is made for the quantity to be determined by means of a machine management system 13, in particular an electronic management system, in particular a control unit 12, as a function of the information from the detection unit 11. It is also preferably determined electronically therefrom whether a sufficient amount of the first food product is present on the first placement device 14. The decision whether a sufficient amount of the first food product is present in the domestic refrigeration appliance 1, in particular on the first placement device 14, is made by a corresponding comparison with at least one characteristic threshold value.

The electronic management system 13 is advantageously designed such that at least one image acquired by the detection unit 11, preferably the image detection unit, is evaluated in such a way that it is possible to identify the first placement device 14 on said image. In a further image evaluation step, on the basis of the identification of the first placement device 14, the amount of the first food product present on the first placement device 14 is determined, if possible, by evaluating the image.

As has already been described above in an advantageous embodiment, the at least one image is acquired by the image detection unit in such a way that, instead of detecting only the region of the receiving space 3 having the first placement device 14, an image-dependent larger region of the domestic refrigeration appliance 1 is detected. The image generated in this way is used to search first for the first placement device 14 in the image by means of an image processing algorithm. If the first depositing device is identified, only this image section of the entire image is investigated in the further evaluation, which image section shows the first depositing device and, if applicable, the first food item deposited on the first depositing device. That is to say, only the image sections which comprise the first placement device 14 and the regions which are formed on the first placement device 14, in particular upwards and backwards, are investigated for the continued evaluation. The occupation area 16 is exemplarily shown in fig. 1.

The working method by means of image evaluation makes it possible to determine the quantity of the first food product, which is arranged in a position-specific manner in the receiving chamber 3, particularly precisely.

This is not taken into account in particular if a further object, in particular a food product 17, is placed in the receiving space 3, in particular on the grid 8, next to the first placement device 14, which further object also serves as a further first food product 15. A completely defined region in the receiving chamber 3 is predetermined by the first placement device 14 of the object, on which region the first food item possibly placed can then be detected in a targeted manner and can be evaluated by image evaluation. That is to say, the system, in particular at least the first depositing device 14, also makes it possible to evaluate, in a targeted manner, only the quantity of the respective food product deposited in position on the first depositing device 14 by means of electronic detection and evaluation.

In the advantageous embodiment already described above, in which the first placement device 14 is preferably arranged in the receiving chamber 3 in a manner that can be removed without damage and can be positioned in different positions in the receiving chamber 3, however, depending on the design of the at least one detection unit 11, in particular when an image is acquired, the first placement device 14 is recognized in the image independently of the respective position and the loading of the first food product is accordingly evaluated site-specifically.

In particular, the first placement device 14 is identified on the basis of its geometry and/or size and/or color, in particular in the case of image recognition.

In an advantageous embodiment, it can be provided that the domestic refrigeration appliance 1 has a second placement device 18 for objects, which is independent of the first placement device 14. The second placement device may be a pad, for example. In the example understood not to be closed in fig. 1, the second placement device 18 is arranged, for example, on the upper side of the further panel 9. The second placement device is arranged in particular on the left side when viewed from the front and is placed in the front region of the pane 9 when viewed in the depth direction. It may be provided that a second food product 19 should be placed on the second placement device 18. This can likewise be effected as already described in the case of the first placement device 14, for example by a user-side specification and stored in the electronic management system 13. In the example shown, the second food product can likewise be a beverage container, but here also not a bottle with its particular shape, but an angular, in particular square, packaging. Here, too, a defined placement position and/or placement orientation for the second food product 19 is predefined by the configuration of the second placement device 18, in particular by a specific recess in the upper side of the second placement device 18. Here too, a very defined and structured positioning of the

food products

15 and 19 on the

placement devices

14 and 18 and thus a positioning pattern can thus be predetermined as in the case of the first placement device 14 with corresponding recesses. This again improves and thus makes it possible to carry out the detection by the detection unit 11 more accurately.

Here, too, as already described in the case of the first placement device 14, the

placement devices

14, 18 are of a size which is significantly smaller than the area of the

panels

8 and 9.

It is also only shown by way of example that a further food item 20 is arranged on the grid 9 next to the second placement device 18.

It may be provided that the upper region in which the first grid 8 and the first placement device 14 are arranged can be detected simultaneously and that the region in which the second grid 9 and the second placement device 18 are arranged can also be detected simultaneously by the detection unit 11. This can be done, for example, by a single image. It can also be provided that the domestic refrigeration appliance 1 has at least two detection units 11, in particular two image detection units, wherein a first detection unit can detect an upper region of the receiving chamber 3 and a further detection unit can detect a lower region of the receiving chamber 3, so that in particular the receiving chamber 3 can be completely detected by the two detection units.

The respective quantities of the first food product 15 and the second food product 19, which are arranged in a position-specific manner only on the

placement devices

14 and 18, can also be determined by the electronic management system 13 from this information.

The determined quantity of food 15 and/or 19 can then be advantageously output to the user via electronic management system 13 and/or a supplementary order for the food can be automatically made via electronic management system 13. The domestic refrigeration appliance 1, in particular the electronic management system 13, can communicate with a provider 22 of such food products, for example via a communication network 21, in particular via the internet.

The electronic management system 13 can query and evaluate, for example, the time of provision and/or the price of the food to be placed on a supplementary order. Whereupon a particular provider is then selected and a corresponding replenishment order is made. This can also be done in the machine so that the electronic management system 13 can be trained.

Advantageously, the electronic management system 13 is designed to be self-learning. This means that machine training can be performed when the corresponding reminder and/or the replenishment order of the first food product 15 and/or the second food product 19 should be made. It is also possible here to automatically adjust specific characteristic thresholds which are used to decide whether the user should be prompted and/or whether the ordering of specific food products should be supplemented.

Provision may also be made for example for a message to be given as a prompt to the user to switch the relevant food product from a further storage area of the domestic refrigeration appliance 1, which is not detectable in particular by the image detection unit 11, to the

respective placement device

14, 18. This may for example be the case if the user places a first food product 15 as shown in fig. 1 on the shelf 8 beside the first placement device 14 and/or for example in the door shelf 7. It is also indicated to the user by the placement devices 14 and/or 18 where the user has to position the corresponding

food

15, 19 in order to achieve detection automatically by the detection unit 11 and evaluation by the electronic management system 13.

In fig. 2 an icon is shown in a diagram, in which a change of the amount of food product 15, for example on the first placement device 14, is depicted. Two characteristic thresholds Z2 and Z4 are here exemplary predefined, which in particular respectively characterize the individual quantities of the first food product. If, for example, a situation occurs in which the first depositing device 14 is loaded with the first food product 15 at the time t1 and is deposited in this case in an orderly manner in an amount Z5, in particular the amount of the first food product 15 on the first depositing device 14 can be monitored, for example, from this time t 1. As can be seen, the quantity Z5 is greater than the quantity predefined by the characteristic thresholds Z2 and Z4.

If a specific amount of the first food product 15 is then removed from the first placement device 14, for example at the point in time t2, and a higher amount of the second characteristic threshold Z4 is reached there, it is determined by the electronic management system 13 that a sufficient amount of said first food product 15 is still present on the first placement device 14. If the removal of the first food product 15 from the first depositing device 14 continues over the continued time profile, for example, at time t3 and time t4, it is recognized that the quantity of the first food product 15 on the first depositing device 14 at time t4 has reached the lower characteristic threshold value Z2.

If the removal of the first food product 15 from the first placement device 14 then continues at a further point in time t5, the lower characteristic threshold value Z2 is undershot and the user is then prompted to start and/or a supplementary order for the first food product 15 is made.

If the first depositing device 14 is then filled with the first food product 15 at a further point in time t6 in such a way that the lower characteristic threshold Z2 is again exceeded at least, this is likewise recognized by the electronic management system 13.

In an advantageous embodiment, it can be provided that, starting from the fact that the filling degree of the first depositing device 14 is greater than the two characteristic thresholds Z2 and Z4, if the quantity of the first food product 15 is below the two characteristic thresholds Z2 and Z4, a prompt is generated and/or a replenishment order is made.

This allows a higher accuracy and an accurate description of whether, for example, a supplementary order is actually required.

If, for example, the first food product 15 is removed from the first placement device 14 and loaded with the first food product such that the respective amount fluctuates slightly about the characteristic threshold value, for example about the characteristic threshold value Z2, if appropriate no prompt is generated and/or no replenishment order is made. This is because it can be determined that the quantity produces the relatively small fluctuations around the characteristic threshold value in a specific time interval and that, if necessary, there can also be a certain tolerance with regard to the detection accuracy. In order to avoid undesired or unwanted supplementary subscriptions here, the actions are prohibited here.

List of reference numerals

1 domestic refrigeration appliance

2 casing

3 receiving chamber

4 inner container

5 door

6 inner side

7 door shelf

7a beverage container

8 first grid

9 second grid

10 food receiving container

11 detection unit

12 control unit

13 electronic management system

14 first placement device

15 first food

16 occupied area

17 additional objects

18 second placement device

19 food product

20 food product

21 communication network

22 provider

t1 time point

t2 time point

t3 time point

t4 time point

Z2 characteristic threshold

Z4 characteristic threshold.

Claims

1. A method for preparing food products in a domestic refrigeration appliance (1), wherein the food products (15, 19) in a receiving chamber (3) of the domestic refrigeration appliance (1) are detected by means of at least one image detection unit (11) of the domestic refrigeration appliance (1) and it is determined therefrom whether the food products (15, 19) are stored in sufficient quantity, characterized in that at least one separate first placement device (14) is placed into the receiving chamber (3) site-specifically, by means of which a position for the determined orientation determination of the first food product is predefined for a user, wherein the first food product (15) can be placed on the first placement device (14) in the receiving chamber (3), and in that at least one image acquired by means of the image detection unit (11) is evaluated as to whether the first placement device (14) is detected, and if the first placement device (14) is identified in the image, determining an amount of a first food item (15) on the first placement device.

2. Method according to claim 1, characterized in that a larger area than an occupation area (16) occupied by the first placement device (14) and a first food item (15) possibly placed on the first placement device is detected by the image detection unit (11), wherein the occupation area (16) is identified when evaluating the at least one image, and only the image part of the image having the occupation area (16) is taken into account for determining the amount of first food item (15) on the first placement device (14).

3. Method according to claim 1 or 2, characterized in that the first placement device (14) is positionally variably positionable in the receiving chamber (3) and that the first placement device (14) is recognized independently of its position when evaluating the image.

4. Method according to any one of the preceding claims, characterized in that a placement position and/or a placement orientation for a first food product (15) is definitively predefined by the first placement device (14), so that the first food product (15) is placed definitively and orderly on the first placement device.

5. Method according to claim 4, characterized in that the placement position and/or placement orientation is predefined by a shape-specific recess in the first placement device (14).

6. Method according to any one of the preceding claims, characterized in that a second placement device (18) is placed into the receiving chamber (3) site-specifically, a placement position determined by the second placement device for determining the orientation of a second food item being predefined by the user, wherein a second food item (19) different from the first food item (15) can be placed on the second placement device (18) in the receiving chamber (3) independently of the first placement device (14), in that at least one image acquired by the image detection unit (11) is evaluated whether the second placement device (18) is detected, and in that if the second placement device (18) is identified in the image, the amount of the second food item (19) on the second placement device is determined.

7. Method according to any of the preceding claims, characterized in that a prompt is output to a user and/or a supplementary order of the food products (15, 19) is automatically generated by a management system (13) of the domestic refrigeration appliance (1) in dependence on the detected amount of at least one food product (15, 19).

8. Method according to claim 7, characterized in that a user presets a provider for the food (15, 19), which provider contacts the preset provider when the order is automatically replenished, in particular by means of a user store.

9. Method according to claim 7, characterized in that the electronic management system (13) searches for the offering time and/or price of the food (15, 19) to be re-ordered via a communication network (21), in particular the internet, and selects a provider according to the offering time and/or price.

10. Method according to one of claims 7 to 9, characterized in that a need for a supplementary order is generated as a reminder and/or a need for exchanging the relevant food product (15, 19) from a further storage region (7) of the domestic refrigeration appliance (1), in particular not detectable by the image detection unit (11), onto the placement device (14, 18) is generated as a reminder.

11. Method according to any of claims 7 to 10, characterized in that for generating a prompt it is checked that: -whether the detected quantity of food (15, 19) is lower than a first characteristic threshold value (Z4) and/or a second characteristic threshold value (Z2) representative of the quantity of food (15, 19) to be evaluated, and/or-when the detected quantity of food (15, 19) is lower than a first characteristic threshold value (Z4) and/or a second characteristic threshold value (Z2) representative of the quantity of food (15, 19) to be evaluated, a supplementary order is made.

12. Method according to claim 11, characterized in that the order is only prompted and/or supplemented when at least the first and second characteristic threshold values (Z4, Z2) are lowered, starting from the initiation of the monitoring of the quantity of food product (15, 19) on the placement device (14, 18).

13. Method according to any of the preceding claims, characterized in that a flexible mat is placed into the receiving chamber (3) as a first placement device (14).

14. Method according to claim 13, characterized in that the pad represents the placement of the first food item (15) to the user according to its size and/or its color, and identifies a food item as a first food item (15) when evaluating the image according to the size and/or color.

15. A domestic refrigeration appliance (1) having: a housing (2) in which at least one receiving chamber (3) for food is formed; at least one detection unit, in particular an image detection unit (11), for detecting at least one partial region of the receiving chamber (3), in particular in image-dependent manner; at least one placement device (14, 18) for food products, in particular independently of the panels (8, 9) or door shelves (7) or drawers (10) conventionally present in the domestic refrigeration appliance (1); and an electronic management system (13), wherein the domestic refrigeration appliance (1) is configured for implementing the method according to any one of the preceding claims.