DE102018202631A1 - Determine a free volume in a household refrigerator - Google Patents

Abstract

A method (S1-S9) is for determining a free volume (Vf) in a refrigerator compartment (4) of a domestic refrigerator (1), wherein at least one distinguishable object (G1, G2, L) present in the refrigerator compartment (4) is separated is measured (S1-S3, S3a), from the measured dimensions of the at least one object (G1, G2, L) whose volume (V1, V2, Vf) is determined (S4, S4a) and from the volume (V1, V2, Vf) of the at least one object (G1, G2, L) the free volume (Vf) is determined (S7). A household refrigerator (1) is set up to perform the procedure. The invention is particularly advantageously applicable to refrigerators.

Description

The invention relates to a method for determining a free volume in a cold room of a household refrigerator. The invention also relates to a household cooling device designed to carry out the method. The invention is particularly advantageously applicable to refrigerators.

JP 2014-209048 A discloses a refrigerator comprising a plurality of image pickup devices for receiving images of a cold room or portion thereof. To determine a free volume of the cold room or subregion thereof, the images are compared with reference images of an empty cold room or partial area thereof. The size of the particular free volume can be displayed to a user. It is disadvantageous that reference images are needed.

WO 2016/173167 discloses another way to determine a free volume in a refrigerator of a refrigerator. For this purpose, an intensity of a visible and infrared light emerging from the cold room is determined in relation to an intensity when the refrigerator is empty. In particular, the volume already occupied is calculated on the basis of a difference between a light intensity between visible light and infrared light radiated into the cooling space and the light proportion thereof reflected in the cooling space. A disadvantage here is that this possibility is only complicated to implement.

KR 2017-0014769 A discloses a method for calculating a void volume of a refrigerator of a refrigerator based on a volume of the refrigerator using so-called voxels ("volume pixels").

JP 2013-108744 A discloses a refrigerator having storage volume estimation means for estimating a volume of goods stored in a refrigerated space. For this purpose, the possibility is described of estimating the storage volume on the basis of a light intensity of light emerging from the cooling space.

CN 105222506 A discloses a way to estimate the volume of goods stored in a refrigerator of the refrigerator based on its weight and type.

It is the object of the present invention to overcome the disadvantages of the prior art at least partially, and in particular to provide a simple and inexpensive feasible way to determine a free space in a refrigerator of a refrigerator precisely.

This object is achieved according to the features of the independent claims. Advantageous embodiments are the subject of the dependent claims, the description and the drawings.

The object is achieved by a method for determining a free volume in a cold room of a household refrigerator, in which at least one distinguishable object present in the cold room is measured individually from the measured dimensions of the at least one object whose volume is determined and from the volume of at least one object the free volume is determined.

This method has the advantage that due to the individual measurement (s), the free volume can be determined particularly accurately. This is possible with simple, possibly already existing in refrigerators funds and thus inexpensive. In particular, no reference images or multiple light sources with different spectra are needed for the method.

The household refrigerator may be a refrigerator, a freezer, etc. The refrigerator may be a whole refrigerator or a portion thereof, e.g. at least one particular refrigerated compartment.

The at least one object present in the refrigerator compartment may comprise exactly one or more objects that can be distinguished from one another.

A distinguishable object is understood in particular to mean that this object can be distinguished from other objects by means of the measuring device or the measuring method, for example if it is arranged with sufficient distance to other objects in the cooling space. If two objects are so close that they are indistinguishable by the measuring device used (e.g., two objects of the same kind stacked on top of each other), they are considered as an object for the process.

The fact that an object is measured individually includes, in particular, that for this object its dimensions are determined independently of other objects that can be distinguished from it. In particular, no measures are determined collectively for a group of multiple distinguishable objects.

The measured measures may generally include all mathematical descriptions (functions, parameters) suitable for determining a shape of a measured object or calculating its volume. The dimensions may include, for example, lengths, curvatures, angles, etc. of an outer contour of an object. In one In a particularly simple case, the dimensions may correspond to a length, a width and a height of an object (eg in the case of a cuboid piece of butter). However, other dimensions characteristic of an object, such as descriptions based on trigonometric relationships (including angles), space curves (eg, polygons), or areas of space (eg, polyhedra) may also be used for description. Such dimensions can also be referred to as contour dimensions. An orientation and / or a position of a measured object in the cooling space can also be used as dimensions.

It is an embodiment that the at least one object corresponds to at least one product stored in the refrigerated space. The good can be a food, medicine or other cool to be stored good. By means of the method, therefore, the dimensions of the discernible goods stored in the refrigerated space can be determined individually and their individual volumes calculated therefrom.

It is an embodiment that the free volume is determined as a difference of a known void volume of the refrigerator compartment minus a sum of the calculated from the dimensions of the at least one Guts volume. This is especially easy to be done.

It is an embodiment that the at least one object is a blank object. Under a blank object can be understood in particular an empty volume of space in the refrigerator. This advantageously allows a direct determination of the free volume. In particular, so need not be detected in the refrigerator stored goods. In this embodiment, therefore, not the dimensions and thus the volumes of stored in the refrigerator goods are determined, but directly the empty volume of space or several empty sub-volumes thereof.

It is an embodiment that in the refrigerator at least one existing distinguishable object by means of visible light, ultrasound, laser light and / or radar is measured individually.

If at least one distinguishable object present in the cooling space is measured individually by means of visible light, the household cooling device can be equipped with at least one camera which is directed into the cooling space or in whose field of vision the cooling space or a part thereof lies. By means of the at least one camera, an image of the cooling space or of a subarea thereof can then be taken up by it.

It is an embodiment that at least one image of the cooling space is recorded by means of at least one camera, an object determination is carried out on the basis of the at least one recorded image, and the dimensions of each at least one distinguishable object determined on the basis of the object determination are calculated. In this embodiment, the measurement method used is thus a camera- or image-based measurement method. This provides the advantage that objects are very precisely distinguishable and measurable. For example, two spatially contiguous goods can be distinguished because of their different surface appearance (e.g., due to different packaging, color, etc.). In particular, it may be advantageous for the at least one camera to be a color-sensitive camera ("color camera") in the visible spectral range. Another advantage is that many refrigerators are already equipped with at least one camera and thus no or only small additional costs to carry out the process arise. In particular, the at least one camera may be at least one camera provided in a door of the refrigerator, but is not limited thereto and may be e.g. a in the refrigerator room cover side, etc. arranged camera include. Yet another advantage is that a volume determination of objects determined by an optical object determination is basically known and therefore can be easily implemented in the context of the method.

By object determination is meant, in particular, a determination of a presence of a distinguishable object, including the ability to determine its dimensions (e.g., a determination that a cuboid object of certain dimensions is present in the cold room). The object determination does not yet include an identification of the type of object (e.g., that the cuboid object is a butterpack), rather, this is the object of object recognition (see below).

It is a development that the method is performed by means of multiple cameras with at least partially the same (overlapping) sensor or field of view. As a result, the dimensions can be tuned more precisely. In particular, optical dead zones of a camera can thus be detected by at least one further camera. A further advantage is that detected object surfaces and thus recognized associated lengths or contours can be correlated due to the known position of the position and orientation of the cameras in the presence of multiple cameras from their different camera views, resulting in lengths or contours and thus volumes of objects particularly accurate let determine. This applies to both good and empty objects.

It is a training that at least two camera at least approximately in one right Angles are aligned with each other. This can be implemented, for example, by a "front-view camera" located in a door and a "top-view camera" arranged on the ceiling side. This makes it possible to determine volumes particularly precisely. For example, then by means of the front camera, a width and height of objects can be determined very accurately, while using the ceiling camera whose width and depth can be determined very accurately.

The use of several cameras can be advantageous for a more accurate object determination and object recognition (see below).

The use of multiple cameras can be analogously applied to the use of other measurement methods such as ultrasound, radar, etc.

It is an embodiment that the object determination of at least one product stored in the cooling space is followed by an object recognition of this property. As a result, the type of object can advantageously also be determined. An object recognition is basically known and therefore easy to implement in the context of the method. Also for object recognition, it is advantageous if the at least one camera is a color camera.

It is an embodiment that the object determination and / or the object recognition comprises an object determination and / or an object recognition of at least one wall region of the cooling space. This advantageously allows an even more accurate calculation of the free volume. For example, it is thus possible to more accurately determine a position and / or a position of a product on the basis of the known position and position of a wall region. Also, the advantage is achieved that a blank object on the wall areas is particularly accurately determined. It is advantageously assumed that the wall areas are recognizable as such at least partially by the measuring method used. A wall area can e.g. a side wall, a rear wall, a floor, an intermediate floor, a ceiling, etc., or part thereof. For example, a blank object can be detected by means of a camera in that a wall area can be seen in an image. The size of the blank object can be determined from the size of the detected wall area, e.g. along with a known distance between a camera and the wall area.

It is an embodiment that a volume of at least one property recognized by the object recognition is determined by matching with an object database. This allows a particularly accurate determination of the volume of a stored in the refrigerator Guts. The object database may contain manufacturer data on (standard) volumes of certain foodstuffs, etc. or typical (standard) volumes of specific packaging. If, for example, a specific item (for example a small yoghurt cup) is recognized by means of an object recognition, a (standard) volume of typical small yoghurt cups can be retrieved from the database and set as the volume of the recognized yoghurt cup. In a further development, object recognition can also be used to detect the manufacturer and / or the exact nature of the item (for example yoghurt cups of the brand X), which further facilitates comparison with the object database for determining a (standard) volume. The comparison with the object recognition can additionally or alternatively be carried out for the determination of the volume from the dimensions of at least one product.

It is a development that the object recognition is set up to perform a text recognition on a good. Thus, the exact nature of the product can be determined even more precisely, for example by means of a recognized textual product name. In particular, a pack size (for example 0.2 liters) that is textually present on the item can be recognized, which can be used for even more precise volume determination, for example also by matching with an object database.

It is a development that the object recognition is set up to perform a code recognition on a good. Thus, a code present on the good can be recognized and thereby the exact nature of the item can be determined even more precisely, in particular by matching with an object database. The code can be an optical code such as a barcode or a QR code. The code can be an EAN code.

The object database can be integrated in the household appliance and / or be present in an external instance with respect to the household appliance, which is data-technically coupled to the household appliance, for example via a communication interface of the household appliance. The communication interface may be a wired interface such as an Ethernet interface, etc., and / or a wireless interface such as a WLAN interface, a Bluetooth interface, and so on.

The object determination and / or the object recognition can be carried out by the household appliance. For this purpose, the household appliance may have a corresponding Datenverarbeitungsvorrichung. Alternatively or additionally, the object determination and / or the object recognition can be performed on an external instance with respect to the household appliance, for example on a server of a manufacturer of the household appliance or in a computer network ("cloud"). In the second case can the home appliance transmit at least one captured image to the external entity where the object determination and / or object detection is performed.

In general, the determination of the dimensions and / or the calculation of the free volume from the measured measures can also be carried out by the domestic appliance and / or by an external entity.

If the at least one distinguishable object present in the cooling space is or will be individually measured by means of ultrasound, at least one ultrasonic transmitter and / or one spatially resolving ultrasonic receiver can be arranged on at least one wall area.

If the at least one distinguishable object present in the cooling space is or will be measured individually by laser light, the cooling space can be scanned by means of a laser beam and a reflection of the laser beam used to measure the distinguishable objects.

It is an embodiment that the free volume is displayed to a user or can be displayed. The free volume may e.g. displayed on a display device of the household refrigerator (segment display, LCD, touch screen, etc.) and / or displayed on an external instance such as a mobile user terminal (e.g., a smartphone, a tablet, etc.). The free volume can, for example, as a percentage of the total volume of the refrigerator or in liters or similar. are displayed.

It is an embodiment that the free volume can be converted into at least one user-selectable "good unit". A good unit can be understood to be a multiple of a volume of a given ("reference") item. Thus, as a reference good a pack of butter of 500 g, a bag of milk or a beer bottle can be used. The reference good underlying the good unit can in particular be selected by a user. For example, a user may select a bottle of beer as a reference good, and the free volume may then be indicated in addition to or as an alternative to a conventional unit (such as liters) by the number of beer bottles that fit into the free volume, e.g. "Still room for four 0.5 l beer bottles". A user can select the reference good from a predefined list and / or define the reference good himself.

The object is also achieved by a household refrigerator, which is adapted to carry out the method as described above. The household refrigerator can be designed analogously to the method and has the same advantages. Also, the method can be formed analogous to the household refrigerator.

In particular, the household cooling device can have at least one measuring device for measuring at least one distinguishable object present in the cooling space.

• - Kamera;
• - Ultraschallmessvorrichtung;
• - Lasermessvorrichtung;
• - Radarmessvorrichtung;

umfassen.The measuring device may include one or more measuring devices from the group:

• - camera;
• - Ultrasonic measuring device;
• - laser measuring device;
• - radar device;

include.

It is a development that the household cooling device has a data processing device for determining distinguishable objects and for determining the associated dimensions and volumes on the basis of the measurement data generated by the at least one measuring device.

It is an embodiment that the cooling space has at least one position and / or length marking (hereinafter referred to as "measurement marking" without restricting the generality). The measurement mark improves accuracy of a measurement of objects in the refrigerator. In particular, a position, position and / or length reference can be provided by means of at least one measurement marking shown in an image. The measuring marking may, for example, comprise a length scale present on a wall region, at least one point-shaped or linear mark having a known position and / or orientation in the cooling space, etc. A mark may be a surface that is visually different (e.g., off-color) from its environment, a characteristic shaped protrusion, and so on. At least one measurement mark can be a dedicated measurement mark and thus have no other function. At least one measurement mark may have at least one additional function, e.g. a refrigerator lamp, a guide for a shelf, etc.

• 1 zeigt als Schnittdarstellung in Seitenansicht ein Haushaltskühlgerät, das zum Durchführen eines Verfahren zum Bestimmen eines freien Volumens in einem Kühlraum des Haushalts-Kühlgeräts ausgebildet ist; und
• 2 zeigt ein Ablaufdiagramm eines Verfahrens zum Bestimmen des freien Volumens.

The above-described characteristics, features and advantages of this invention, as well as the manner in which they are achieved, will become clearer and more clearly understood in connection with the following schematic description of an embodiment which will be described in detail in conjunction with the drawings.

• 1 shows a sectional side view of a household refrigerator, which is designed for carrying out a method for determining a free volume in a cooling space of the household refrigerator; and
• 2 shows a flowchart of a method for determining the free volume.

1 shows a sectional view in side view of a household refrigerator 1 with a fridge 2 and a freezer 3 , The refrigerator 2 has a refrigerator 4 for receiving goods G1 . G2 on. The fridge 4 has a void volume VL on. The goods G1 . G2 Here are purely exemplary on different shelves 5 stored.

The fridge 4 is by means of a front door 6 closable. In the door 6 is a camera 7 available, by means of pictures or pictures of the refrigerator 4 are receivable. In general, however, other cameras may be present, which images of the refrigerator 4 be able to record. The camera 7 is with a data processing device 8th (For example, a central control device) data technology coupled. The data processing device 8th is also eg with a communication interface 9 and a display device 10 data-technically coupled.

The fridge 4 has several through the camera 7 recognizable wall areas 11 . 12 . 13 . 14 on, for example, a back wall 11 , A blanket 12 , a floor 13 and a respective sidewall 14 , Also the shelves 5 can represent wall areas. In addition, the refrigerator can 4 at least one measuring mark 15 here symbolically as a on a side wall 14 For example, imprinted, imprinted etc. ruler is indicated. The at least one measuring mark 15 is in a field of view of the camera 7 ,

2 shows a flowchart of a method for determining the free volume.

In a first step S1 of the procedure is done by means of the camera 7 at least one picture of the refrigerator 4 added.

In a second step S2 Based on the at least one recorded image, an object determination of the goods G1 . G2 carried out. If the goods G1 . G2 in which at least one image is spaced apart, they are considered distinct G1 . G2 certainly. The object determination can be an object determination of at least one wall area 5 . 11 - 14 include to a position and / or location of the goods G1 . G2 in the fridge 4 and thus their volumes V1 . V2 to be able to determine even more precisely.

In an optional third step S3 can the goods G1 and G2 in which at least one image of an object recognition are subjected in order to be able to recognize and distinguish them more precisely. The object recognition may include text recognition and / or code recognition. The object recognition may be an object recognition of at least one wall area 5 . 11 - 14 include.

In a fourth step S4 become the determined and possibly recognized goods G1 . G2 individually measured on the basis of the at least one image. This can be done by means of the data processing device 8th be carried out to which the at least one image from the camera 7 has been transmitted. Alternatively, step S3 by means of an external instance (not shown), which is connected via the communication interface with the household refrigerator 1 can be coupled. To measure the size of the goods G1 . G2 with the measuring mark 15 linked, in particular compared. It may be particularly advantageous, although a position of the goods G1 . G2 in the fridge 4 is determinable.

In a fifth step S5 The volumes are calculated on the basis of the measured dimensions V1 and V2 the goods G1 and G2 certainly. This can be done by means of the data processing device 8th be performed. Alternatively, step S5 be performed by the external entity.

In an optional sixth step S6 can the volumes V1 . V2 by matching with an object database 16 be determined. The object database 16 can be a part of the household refrigerator 1 represent or - as drawn - in an external instance 17 (eg on a server, on a user terminal such as a smartphone, in the cloud, etc.), the external instance 17 via the communication interface with the household refrigerator 1 can be coupled. The step S6 at least for a good G1 . G2 instead of or in addition to step S5 be performed.

In a seventh step S7 becomes a free volume Vf of the refrigerator 4 as the difference of the void volume VL and the volumes V1 and V2 determined, ie, according to Vf = VL - (V1 + V2).

In an eighth step S8 becomes the free volume Vf displayed to a user, for example on the display device 10 or at one with the household refrigerator 1 via the communication interface can be coupled user terminal etc.

In an optional ninth step S9 can the free volume Vf be converted and displayed in at least one selectable by a user unit of property, for example, in "milk carton units" or "beer bottle units".

Additionally or alternatively to the goods G1 . G2 the measured object can also be a blank object L, ie directly the free volume Vf outside the goods G1 . G2 is determined. The empty object L can be identified by the wall areas recognizable by the camera 5 . 11 - 14 be recognized and measured. The calculated volume thus already corresponds to the free volume Vf , Around the wall areas 5 . 11 - 14 can detect particularly precise, in step S2a, an object recognition of the wall areas 5 . 11 - 14 be performed.

Of course, the present invention is not limited to the embodiment shown.

Thus, for the measurement, in addition to or as an alternative to the camera, at least one ultrasound measuring device, at least one laser measuring device and / or at least one radar measuring device can be used.

Generally, "on", "an", etc. may be taken to mean a singular or a plurality, in particular in the sense of "at least one" or "one or more" etc., unless this is explicitly excluded, e.g. by the expression "exactly one", etc.

LIST OF REFERENCE NUMBERS

1

Household refrigerator

2

fridge

3

freezer

4

refrigerator

5

false floor

6

door

7

camera

8th

Data processing device

9

Communication Interface

10

display device

11

rear wall

12

ceiling

13

ground

14

Side wall

15

measurement mark

16

Object Database

17

External instance

G1

Well

G2

Well

V1

Volume of Good G1

V2

Volume of Good G2

Vf

Free volume

VL

void

S1-S9

steps

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• JP 2014209048 A [0002]
• WO 2016/173167 [0003]
• KR 20170014769 A [0004]
• JP 2013108744 A [0005]
• CN 105222506 A [0006]

Claims (13)

Method (S1-S9) for determining a free volume (Vf) in a cooling space (4) of a household refrigerating appliance (1), in which - At least one in the refrigerator (4) existing distinguishable object (G1, G2, L) is measured individually (S1-S4), - From the measured dimensions of the at least one object (G1, G2, L) whose volume (V1, V2, Vf) is determined (S5, S6) and - From the volume (V1, V2, Vf) of the at least one object (G1, G2, L), the free volume (Vf) is determined (S7). Method (S1-S9) according to Claim 1 wherein the at least one object corresponds to at least one product (G1, G2) mounted in the cooling space (4). Method (S1-S9) according to Claim 2 in which the free volume (Vf) is determined as a difference of a known empty volume (VL) of the refrigerator compartment (4) minus a sum of the volume (V1, V2) calculated from the dimensions of the at least one item (G1, G2) (S7) , Method (S1-S9) according to one of the preceding claims, wherein the at least one object is an empty object (L). Method (S1-S9) according to Claim 4 , wherein the empty object (L) is detected on the basis of exposed wall regions (5, 11-14) of the cooling space (4). Method (S1-S9) according to one of the preceding claims, wherein in the cold room at least one existing distinguishable object (G1, G2, L) is measured individually by means of visible light, ultrasound, laser light and / or radar. Method (S1-S9) according to one of the preceding claims, wherein - at least one image of the cooling space (4) is recorded by means of at least one camera (7) (S1), - Based on the at least one recorded image, an object determination on distinguishable objects (G1, G2, L) is carried out (S2) and - the dimensions of each determined by object determination at least one distinguishable object (G1, G2, L) are calculated (S4). Method (S1-S9) according to Claim 7 in conjunction with one of Claims 2 or 3 , wherein the object determination (S2) of at least one product (G1, G2) stored in the cooling space (4) is followed by an object recognition (S3) of this property (G1, G2) and a volume (V1, V2) of one by means of the object recognition (S3 ) Guts (G1, G2) by comparison with an object database (16) is determined (S6). Method (S1-S9) according to one of the preceding claims, wherein the object determination (S2) and / or the object recognition (S3) comprises an object determination and / or object recognition of at least one wall region (4, 11-14) of the cooling space (4). Method (S1-S9) according to one of the preceding claims, wherein the free volume (Vf) is displayed to a user. Method (S1-S9) according to one of the preceding claims, wherein the free volume is convertible into at least one user-selectable good unit (S9). Household refrigerating appliance (1), characterized in that the household refrigerating appliance (1) is adapted to perform the method (S1-S9) according to one of the preceding claims. Household cooling unit (1) after Claim 13 , wherein the cooling space (4) has at least one measuring mark (15).

Images