DE102020206008A1 - Taking pictures of a drawer of a household refrigerator - Google Patents

Abstract

A method (S0-S3) is used to record images of an at least partially open drawer (5, 11) of a household refrigerator (1) by means of at least one camera (9), with a movement being carried out by means of an acceleration sensor (17) attached to the drawer of the drawer is determined (S0) and at least one image of an interior space of the drawer is recorded by means of the at least one camera if the movement of the drawer fulfills at least one criterion (S1-S3). A household refrigerator (1) is designed to carry out the method and comprises a refrigerator (2, 10) and at least one pull-out drawer housed in the refrigerator, at least one acceleration sensor attached to the drawer and one with the acceleration sensor and the at least one camera for data purposes connected trigger device (16), which is set up to receive sensor data from the acceleration sensor, to determine a movement of the drawer from the sensor data, and, if movement meets at least one predetermined criterion, to output at least one command to the at least one camera for image recording.

Description

The invention relates to a method for taking pictures of an at least partially open drawer of a household refrigerator by means of at least one camera. The invention also relates to a household refrigerator, having a cooling space and at least one pull-out drawer accommodated in the cooling space, as well as at least one camera which is designed to take at least one image of an interior of the at least partially opened drawer.

EP 2 995 889 B1 discloses a refrigerator comprising: a storage compartment, a drawer movably provided in the storage compartment and provided with an optical mark; a camera configured to capture an image of the inside of the drawer from outside the drawer; and a controller which is designed to register a position of the marking in a plurality of images captured via the camera at time intervals and to determine status information on the drawer on the basis of a change in the position of the marking in the plurality of images.

EP 2 998 671 B1 discloses a refrigerator comprising: a storage compartment formed in a cabinet of the refrigerator by a solid insulation wall, the storage compartment being provided with an access opening, a door pivotably provided on the cabinet, and for opening and closing the access opening and a camera module installed inside the refrigerator, the camera module comprising: a camera lens, a transparent window, and a heating element configured to heat the transparent window, the transparent window having a rectangular shape; and the heating element has a rectangular shape, wherein power is continuously supplied to the heating element so that the temperature of the transparent window is maintained between 0.5 times to 0.7 times the temperature of the condensation point in ° C.

EP 3 040 773 A1 discloses a camera device for a refrigerator and a refrigerator with such a camera device. This refrigerator camera device includes: a drawer that can be placed inside the refrigerator, a camera inside the drawer, and a camera window for capturing an image of the inside of the refrigerator using the camera provided on a surface portion of the drawer. The camera device is configured in such a way that the interior of the refrigerator with the drawer arranged therein is captured by the camera.

It is the object of the present invention to at least partially overcome the disadvantages of the prior art and, in particular, to provide an inexpensive and particularly reliable option for taking pictures from a drawer of a household refrigerator.

This object is achieved according to the features of the independent claims. Advantageous embodiments are the subject of the dependent claims, the description and the drawings.

• - mittels eines an der Schublade angebrachten Beschleunigungssensors eine Bewegung der Schublade ermittelt wird und
• - mittels der mindestens einen Kamera mindestens ein Bild eines Innenraums der Schublade aufgenommen wird, falls die Bewegung der Schublade mindestens ein Kriterium erfüllt.

The object is achieved by a method for taking pictures of an, in particular at least partially open, drawer of a household refrigerator by means of at least one camera, in which

• - A movement of the drawer is determined by means of an acceleration sensor attached to the drawer, and
• at least one image of an interior space of the drawer is recorded by means of the at least one camera if the movement of the drawer meets at least one criterion.

Determining (which can also be referred to as determining or recording) the movement of the drawer by means of the acceleration sensor has the advantage that the movement can be determined robustly and very precisely with a small apparatus structure. In addition, the camera can be positioned in a number of ways.

A movement can be understood, e.g. by integrating the acceleration measured by the acceleration sensor over time, a distance covered by the drawer or its position, its speed and / or a direction of the movement.

The type of acceleration sensor is not limited and can be, for example, a linear acceleration sensor or a gyroscope or gyro sensor. The acceleration sensor can be, for example, a laser-based sensor, a piezoelectric sensor or a MEMS sensor.

It can be sufficient that the acceleration sensor detects the acceleration in only one (linear) direction, namely the pull-out or push-in direction of the drawer, which typically corresponds to the depth direction of the refrigerator. However, in principle, several acceleration sensors can also be attached to the drawer, which are provided (ie, set up and arranged). It is a further development that an acceleration sensor measures the (linear and possibly rotational) accelerations in several directions of acceleration.

It is a further development that several acceleration sensors are integrated in a common module. For example, several acceleration sensors can be integrated in what is known as an “inertial measurement unit”, IMU. The IMU can also be referred to as a multi-axis accelerometer.

If an acceleration sensor measures in several directions of acceleration and / or several acceleration sensors are integrated in a common module, it is a further development that the measurement data of only the acceleration sensor measuring the linear acceleration in the extension or insertion direction are used to determine the movement. Alternatively, the measurement data in at least one further direction of acceleration can also be used to determine the movement.

The household refrigerator can be a refrigerator, a freezer, or a combination thereof. The household refrigerator can have one or more cooling spaces.

The drawer can be a drawer ("basket") which is accommodated in a cold room of the domestic refrigeration appliance and which is accessible when the cold room door is open and, for example, can be pulled out and pushed in manually by a user. The drawer can, however, also be a drawer (“compartment drawer”) that fills a refrigerator compartment and into which a door for this refrigerator compartment is integrated at the front. The compartment drawer can - together with the door - e.g. be extended manually or automatically from the front of the refrigerator.

If there are several drawers (e.g. one or more baskets and / or one or more compartment drawers), a respective acceleration sensor can be attached to one, several or all of them. The plurality of drawers can be arranged together in a cold room (e.g. one drawer for fruit and vegetables, one drawer for meat products, etc.). If the refrigerator has several cold rooms, the drawers can also be distributed over the several cold rooms. A cold room can be used to cool items at a temperature above freezing point, e.g. between +4 ° C and +8 ° C. A refrigerator compartment can also be a freezer compartment.

The recording of the image can be the recording of exactly one image or the recording of a series of images (e.g. in the form of a video).

It is a further development that the camera is arranged separately from the drawer on the household refrigerator. This advantageously enables a particularly varied arrangement of the camera. It is a further development that at least one camera is arranged above at least one drawer, which results in the advantage that the interior can be recorded from a particularly favorable direction and thus the interior of the drawer and its contents can be seen particularly well. Yet another advantage is that a camera arranged in this way can, if necessary, record images from several drawers. This development is particularly advantageous when baskets are used, with the camera then, for example, on a ceiling of the refrigerator compartment, on a left and / or right side wall of the refrigerator compartment (advantageously in front of the shelves), on a front edge of a shelf and / or on an inside the door can be arranged.

It is a further development that the camera is also arranged on the drawer on which the acceleration sensor is also located. This has the advantage that the contents of the drawer are always in the field of view of the camera. This development is particularly advantageous for a specialist drawer.

A further development, which is particularly advantageous for recording images from an extended compartment drawer, is that at least one camera is arranged on an outside of the cooling device, in particular on its front side, especially above the at least one compartment drawer.

• - mittels des Beschleunigungssensors ermittelt wird, um welche Strecke („Wegstrecke“) bzw. wie weit die Schublade bezüglich ihrer vollständig eingeschobenen Position ausgezogen ist und
• - mindestens ein Bild eines Innenraums der Schublade aufgenommen wird, falls die Wegstrecke eine Mindeststrecke erreicht oder überschritten hat.

It is an embodiment that

• - The acceleration sensor is used to determine the distance (“distance”) or how far the drawer has been pulled out in relation to its fully inserted position and
• - At least one image of an interior of the drawer is recorded if the distance has reached or exceeded a minimum distance.

The movement here includes the distance or pull-out position of the pulled-out drawer. The criterion or condition is reaching or exceeding the minimum distance. This has the advantage that no pictures are taken in which the contents of the drawer are not or only partially in the field of view of the camera.

The criterion of reaching or exceeding the minimum distance can be a necessary criterion. This means that by means of the at least one camera can only take at least one image when the distance has reached or exceeded a minimum distance. However, no images need to be taken then, but only when at least one further criterion is met, e.g. the speed of the movement is zero (the drawer is no longer moved) and / or a movement reversal takes place (the drawer is pushed back in again will).

It is a further development that at least one image is recorded when the minimum distance is reached or exceeded. Reaching or exceeding the minimum distance is a sufficient criterion here. In other words, reaching or exceeding the minimum distance represents a triggering event or “trigger” for triggering the at least one camera. If a series of images is recorded, it can be recorded in a further development until the minimum distance is exceeded again.

In one embodiment, a direction of movement of the drawer is determined by means of the acceleration sensor and at least one image of the interior of the drawer is recorded by means of at least one camera when the drawer is pushed in. This has the advantage that the at least one image is recorded when a user has probably re-equipped the drawer and then pushes it back in again. With a high degree of probability, all refrigerated goods that have been brought in and out of the drawer are then shown on the at least one image. The criterion is therefore the detection of an insertion movement of the drawer.

The direction of movement can also be a necessary or a sufficient criterion. It is a further development that at least one image is then recorded if, in addition to the condition that the minimum distance has been reached or exceeded, an insertion movement of the drawer is recognized (insertion movement as a necessary criterion). It is also a further development that at least one image is recorded when, regardless of whether the minimum distance has been reached or exceeded, an insertion movement of the drawer is recognized (insertion movement as a sufficient criterion). In particular, the camera can be triggered or triggered at the beginning of the insertion movement, which has the advantage that the drawer is then still particularly wide open.

In principle, any movement criteria can be combined. It is also possible to record the at least one image or to trigger an image recording when the drawer is opened a minimum distance, an insertion movement is recognized and the distance of the insertion movement has reached or exceeded a predetermined further minimum distance.

Further criteria or conditions can also be taken into account, for example a time: for example, an image recording (of a single image or an image sequence) can be triggered when an insertion movement has been detected and a predetermined period of time (e.g. 0.1 s) has passed from this point in time is, possibly under the further criterion that the insertion movement continues after the time has elapsed, etc. This has the advantage that slight, possibly unintentional movements of the drawer in the insertion direction do not trigger an image recording.

It is an embodiment that at least one criterion is automatically adapted. This has the advantage that the image recording can be adapted to user habits. For automatic adaptation, the cooling device can in particular be designed to be self-learning, e.g. on the basis of fuzzy logic, artificial intelligence, "deep learning", etc.

It is a further development that the minimum distance over which the camera can record the at least one image is automatically adapted. This can be advantageous, for example, if a user frequently does not pull out the drawer completely in order to remove or insert refrigerated items from it. If, for example, the minimum distance is initially set to 90% of full extension (e.g. ex works) and the user typically only pulls the drawer open to 70% (e.g. in half of the cases), the cooling device can reduce the minimum distance to e.g. 65% or 70%. of the full extension can be changed in order to cover as many loading processes as possible.

It is a further development that the minimum distance over which the camera can record the at least one image is adapted or can be adapted by the user. This has the advantage that the minimum route can be adapted particularly reliably and precisely to user habits.

It is a further development that the minimum distance over which the camera can take the at least one image can be adjusted by remote maintenance, e.g. by a customer service. This has the advantage that the minimum route can be adapted to user habits in a particularly user-friendly manner.

The recorded images can be used in a generally known manner for storage, for example to keep which refrigerated goods are stored in the refrigerator in order to create an electronic shopping list, etc.

It is an embodiment that at least one further action is triggered if the movement of the drawer meets at least one criterion. This has the advantage that further user-friendly functions can be triggered by the acceleration sensor. The at least one criterion or condition used here can differ from the at least one criterion for triggering an image recording.

It is an embodiment that the at least one further action comprises a change in an illuminance which can be set for illuminating the drawer (which is generated, for example, by at least one lamp illuminating the drawer). For example, the illuminance can be increased before or after the minimum distance provided for image recording has been reached. Furthermore, when the drawer is pulled out, the illuminance can be increased at least partially in proportion to the distance traveled and / or reduced when the drawer is pushed in.

It is a further development that the at least one further action includes a brief increase in the illuminance (e.g. also triggering a flash) with the image recording, i.e. e.g. with detection of an insertion movement of the drawer.

It is an embodiment that the at least one further action comprises changing a light color of an illuminating light radiated into the drawer.

It is an embodiment that the at least one further action comprises an automatic retraction and extension of the drawer (in particular a compartment drawer). This further increases user convenience. If, for example, an initial manual pulling out of a compartment drawer from the closed position is recognized, a drive motor can then be activated to automatically extend the compartment drawer. Similarly, if manual insertion of a compartment drawer is detected, the drive motor for automatically retracting the compartment drawer can be activated. In particular, the automatic retraction can also be dependent on the fact that the compartment drawer has previously been extended a determined distance, so that a position of the drawer and the detection of a retraction are used here as criteria.

• - einen Kühlraum und mindestens eine in dem Kühlraum untergebrachte ausziehbare Schublade (Korb oder Fachschublade),
• - mindestens eine Kamera, die zum Aufnehmen mindestens eines Bild eines Innenraums der zumindest teilweise aufgezogenen Schublade vorgesehen ist,
• - mindestens einen an der Schublade angebrachten Beschleunigungssensor und
• - eine mit dem Beschleunigungssensor und der mindestens einen Kamera datentechnisch verbundene Auslöseeinrichtung („Triggereinrichtung“), die dazu eingerichtet ist, Sensordaten des Beschleunigungssensors zu empfangen, aus den Sensordaten eine Bewegung der Schublade zu ermitteln, und, falls Bewegung mindestens ein vorgegebenes Kriterium erfüllt, mindestens einen Befehl (auch als „Triggersignal“ bezeichenbar) an die mindestens eine Kamera zur Bildaufnahme auszugeben.

The object is also achieved by having a household refrigerator

• - a cold room and at least one pull-out drawer (basket or compartment drawer) housed in the cold room,
• - At least one camera which is provided for taking at least one image of an interior space of the at least partially opened drawer,
• - at least one acceleration sensor attached to the drawer and
• - A triggering device ("trigger device") which is connected to the acceleration sensor and the at least one camera and is set up to receive sensor data from the acceleration sensor, to determine a movement of the drawer from the sensor data, and, if movement fulfills at least one predetermined criterion, to output at least one command (which can also be referred to as a “trigger signal”) to the at least one camera for image acquisition.

The household refrigerator can be designed analogously to the method, and vice versa, and has the same advantages. For example, the at least one predetermined criterion can include reaching a minimum distance when pulling out the drawer, the pulled-out drawer comes to a standstill and / or the detection of an insertion movement of the drawer. For example, the trigger device can be set up to determine from the sensor data the distance by which the drawer has been pulled out and, if the distance has reached or exceeded a predetermined minimum distance, output at least one command to the at least one camera to take at least one picture. Additionally or alternatively, the trigger device can be set up to determine from the sensor data when the drawer is pushed in and then output at least one command to the at least one camera to take at least one picture, etc.

In general, the acceleration sensor, the trigger device and / or the camera can be separate components of the cooling device and can be arranged at different points on the cooling device. With a spaced arrangement, they can be wired or wirelessly connected to one another. If wireless data transmission is used, the trigger device can, for example, be connected to a communication device which transmits data wirelessly and which transmits the trigger signal to the camera for image recording. A corresponding receiver can be assigned to the at least one camera, so that the image recording is triggered when the trigger signal is received. If there are several cameras, they can be connected together with a receiver or connected to a respective receiver. Are If several cameras are available, camera-specific trigger signals can be sent out in order to trigger the cameras independently of one another to record images, possibly at different times.

The wireless data transmission can take place e.g. via Bluetooth, NFC, WiFi, etc.

In general, the data transmission can also take place bidirectionally, so that data can then be sent to the trigger device, e.g. to adapt the trigger signal.

It is an embodiment that the acceleration sensor is set up to be supplied inductively with electrical energy. The supply of electrical energy ("hereinafter also simply referred to as" power supply ") via inductive or transformer energy transmission can take place in a fundamentally known manner, for example in that a primary coil is present in the cooling chamber of the cooling device assigned to the drawer, which at least when The retracted drawer is located at a short distance from a secondary coil arranged on the drawer and connected to the acceleration sensor. The energy is then transmitted by induction of an electric current in the secondary coil on the basis of alternating magnetic fields generated by the primary coil works practically lock-free, allows a varied arrangement of the coil pair (for example on a rear wall, a side wall, a floor or a front side of the drawer and the refrigerator compartment) and does not hinder movement of the drawer.

Another advantage of inductive or transformer energy transmission is that data transmission via the coils can also be used to transmit data, e.g. by means of amplitudes and / or frequency modulation.

It is particularly advantageous if the acceleration sensor with the secondary coil (and possibly an electronic one for rectifying, smoothing, etc.) the induced electrical signals) is accommodated in a common housing or is present as a module. The power supply when the drawer is pulled out can be ensured, for example, by a capacitor.

In one embodiment, the acceleration sensor is connected to a battery (disposable battery or rechargeable battery) arranged on the drawer in order to supply it with operating current. This advantageously enables a particularly simple construction of the cooling device. In particular, the battery can be replaced by the user. It is particularly advantageous if the acceleration sensor is accommodated with a battery compartment in a common housing or is present as a module.

It is a further development that the power supply of the acceleration sensor takes place via electrical sliding contacts or plug-in contacts, the sliding contacts arranged on the drawer or the electrical plug-in element arranged on the drawer advantageously being on the rear wall of the drawer.

In a further development, the acceleration sensor is supplied with power via a flexible electrical cable, which has the advantage that the acceleration sensor can also be supplied with operating current in the extended state without a time limit.

It is an embodiment that the acceleration sensor (possibly together with its drawer-side power supply components) is attached to the drawer in a form-fitting manner, e.g. by means of a latching (for example via latching lugs, etc.). It is an alternative or additional embodiment that the acceleration sensor is attached to the drawer in a force-locking manner, e.g. by clamping or clipping on by means of a clamp. It is an alternative or additional embodiment that the acceleration sensor is firmly attached to the drawer, e.g. by means of adhesive bonding. However, it is also possible to inject the acceleration sensor with the drawer while it is being manufactured.

It is a further development that the acceleration sensor is attached to the drawer in a form-fitting and / or force-fitting manner and can be removed by the user. This has the advantage that the drawer (especially if it is in the form of a basket) can be washed without exposing the acceleration sensor to the washing water. In addition, it is particularly easy to change the battery, for example. There is also advantageously the possibility of replacing the acceleration sensor as such, for example if it is a disposable part or is defective.

It is an embodiment that the acceleration sensor and the trigger device, possibly together with the drawer-side power supply components) are integrated in a common module that can be arranged on the drawer (also referred to as a “measurement / trigger module”). This gives the advantage of an arrangement that is particularly simple in terms of structure and assembly. In addition, the amount of data required to trigger the at least one camera is significantly reduced, e.g. to the transmission of a simple trigger signal from the module to at least one camera.

It is a particularly advantageous embodiment for the case that the camera is not arranged on the drawer that the module containing the trigger device also includes a communication device for wireless communication with the camera. In this way, the camera can be arranged in a particularly flexible manner with little wiring effort. This arrangement can also be advantageous if the camera is arranged on the drawer, but separately from the trigger device or a corresponding module.

A configuration provided for the case that the camera is also arranged on the drawer is that the camera is integrated into the module. A dedicated communication device for communicating with the camera can thus advantageously be dispensed with. If the camera is arranged separately from the module on the drawer, it can communicate with the module wirelessly or by wire.

The power supply of the module can be done in the same way as the above-described power supply of the acceleration sensor, e.g. inductively, by means of a battery, etc. The module can also be attached to the drawer in the same way as described above only for the acceleration sensor, e.g. by Plug in, clip on, inject, etc.

The development that the acceleration sensor, the trigger device, the wireless communication device and the drawer-side secondary coil of the inductively operating power supply device are integrated in a common module that can be removed from the drawer is particularly advantageous.

However, the trigger device can in principle also be integrated into the camera or form a module (“camera module”) together with the camera.

It is a further development that the acceleration sensor or the module is encapsulated in a moisture-proof or watertight manner, which extends its service life.

The object is also achieved by a drawer as described above. In the simplest case, this is a drawer with an acceleration sensor arranged on it.

• 1) Als Sensorelement wird ein Magnet in Kombination mit einem Hallsensor oder Reed-Kontakt oder einem magnetoresistiven Sensor eingesetzt. Dabei kann ein Magnet an der Schublade angebracht sein, so dass dieser im regulären Gebrauch gegen äußere Einflüsse geschützt ist. Dies kann durch eine Verwahrung in einem separaten Gehäuse oder bereits durch Miteinspritzen des Magneten während der Fertigung der Schublade erfolgen. Beim Überfahren des Sensors durch den Magneten wird ein Triggersignal direkt oder über eine zusätzliche Steuereinheit an die Kamera übermittelt und mindestens ein Bild des Schubladeninhalts aufgenommen. Durch Variation der Zahl von Magneten und/oder Sensoren ist eine beliebige Erhöhung der Zahl der Triggersignale variabel möglich.
• 2) Die Ermittlung der Bewegung der Schublade erfolgt durch einen Kamera mittels mindestens einer Referenzmarke, welcher an der Schublade angebracht ist. Die Art und/oder Form der optischen Marke ist nicht vorgegeben, jedoch sollte vorteilhafterweise sichergestellt sein, dass bei Bewegung der Schublade der Marker immer im Blickfeld der Kamera liegt. Um das Triggersignal zur Bildauslösung zu erhalten wird, die Position des Markers mittels einer Bildfolge, insbesondere Video, kontinuierlich aufgezeichnet. Durch Auswertealgorithmen lässt sich dadurch die Bewegung (z.B. eine Bewegungsrichtung und Position) der Schublade bestimmen. Wird dabei z.B. erkannt, dass der maximale Auszug erreicht ist und eine Schließbewegung stattfindet, wird der aktuelle Frame des Videos in ein Bild umgewandelt. Über die Zahl und/oder Form der Marke(n) lässt sich eine vordefinierte Position oder eine vollständige Wegmessung realisieren.
• 3) Es wird ein kapazitiver Sensor über der zu detektierenden Schublade platziert. Der Sensor ist nach unten empfindlich und detektiert eine seitliche Wand der Schublade (insbesondere deren oberen Rand) oder andere vorgegebene Referenzflächen. Die Schublade ist so gestaltet, dass sie über ihre gesamte Länge ein leichtes Gefälle aufweist. Wird die Schublade ausgezogen, verändert sich der Abstand zwischen dem kapazitiven Sensor und der Schubladenseitenwand, was zu einer Änderung des Messwerts führt. Über diese Änderung kann die Position der Schublade sowie Auszugsrichtung und Geschwindigkeit gemessen werden. Je nach Einstellung können so ein oder mehrere Triggersignale zur Bildaufnahme generiert werden.

However, instead of or in addition to using the acceleration sensor, the following methods can also be used to detect movement of the drawer:

• 1) A magnet in combination with a Hall sensor or reed contact or a magnetoresistive sensor is used as the sensor element. A magnet can be attached to the drawer so that it is protected against external influences during regular use. This can be done by storing them in a separate housing or by injecting the magnet at the same time as the drawer is being manufactured. When the magnet passes over the sensor, a trigger signal is transmitted to the camera directly or via an additional control unit and at least one image of the contents of the drawer is recorded. By varying the number of magnets and / or sensors, any increase in the number of trigger signals is variably possible.
• 2) The movement of the drawer is determined by a camera using at least one reference mark which is attached to the drawer. The type and / or shape of the optical mark is not specified, but it should advantageously be ensured that the marker is always in the field of view of the camera when the drawer is moved. In order to obtain the trigger signal for image release, the position of the marker is continuously recorded by means of an image sequence, in particular video. The movement (for example a direction of movement and position) of the drawer can be determined by means of evaluation algorithms. If, for example, it is recognized that the maximum extension has been reached and a closing movement takes place, the current frame of the video is converted into an image. A predefined position or a complete path measurement can be implemented via the number and / or shape of the mark (s).
• 3) A capacitive sensor is placed over the drawer to be detected. The sensor is sensitive downwards and detects a side wall of the drawer (in particular its upper edge) or other predetermined reference surfaces. The drawer is designed so that it has a slight slope over its entire length. If the drawer is pulled out, the distance between the capacitive sensor and the drawer side wall changes, which leads to a change in the measured value. This change can be used to measure the position of the drawer as well as the direction of extension and speed. Depending on the setting, one or more trigger signals can be generated for image acquisition.

These methods have the particular advantages that no electronics are required in the drawer, the drawer can be removed for cleaning / replacement without great effort and they is insensitive to dirt and condensation.

• 1 zeigt als Schnittdarstellung in Seitenansicht eine Skizze eines Kühlgeräts gemäß einem ersten Ausführungsbeispiel;
• 2 zeigt eine Skizze eines an einer Schublade des Kühlgeräts gemäß dem ersten Ausführungsbeispiel angebrachtes Moduls; und
• 3 zeigt ein mögliches Ablaufdiagramm zum Auslösen mindestens eines Bilds.

The properties, features and advantages of this invention described above and the manner in which they are achieved will become clearer and more clearly understood in connection with the following schematic description of an exemplary embodiment which is explained in more detail in connection with the drawings.

• 1 shows, as a sectional illustration in side view, a sketch of a cooling device according to a first embodiment;
• 2 shows a sketch of a module attached to a drawer of the refrigerator according to the first embodiment; and
• 3 shows a possible flow chart for triggering at least one image.

1 shows as a sectional illustration in side view a sketch of a cooling device 1 . The cooling device 1 has a cold room 2 with a front loading opening 3 which can be locked by means of a door (not shown). Chilled goods (not shown) can be accommodated in the cold room, for example by placing them on shelves 4th or in a pull-out drawer in the form of a basket 5 . The basket 5 is shown in dashed lines in its partially extended position.

The basket 5 has here on its rear side a measuring / trigger module clipped onto it in a form-fitting and / or force-fitting manner that can be removed 6th on that in the inserted state of the basket 5 one in a back wall of a body 7th integrated primary coil 8th with a small distance opposite. module 6th and primary coil 8th but can in principle also be arranged at other locations, for example on the side walls of the basket 5 and body 7th .

On a ceiling of the body 7th is a camera 9 present, through which images of an interior of the at least partially extended basket from above 5 are recordable. Alternatively or additionally, a camera can also be arranged on an inside of the door.

The cooling device 1 can optionally have another cold room 10 (eg a freezer compartment) in which a manually and / or motorized pull-out drawer 11th is housed. The compartment drawer 11th has a front door (drawer door 12th ) together with the compartment drawer 11th is moved. On the compartment drawer 11th is an example here on the drawer door 12th also a measurement / trigger module 13th appropriate.

2 shows a sketch of the measurement / trigger module 6th of the basket 5 . The module 6th has a secondary coil 14th in which the when the basket is retracted 5 by one from the primary coil 8th generated alternating field alternating currents are inducible. The alternating currents are generated by electronics 15th rectified and smoothed and are then available to a trigger device in the form of trigger electronics 16 , an accelerometer in the form of an IMU 17th and a communication device 18th for wireless data transmission (e.g. on the basis of Bluetooth, NFC or WiFi) as operating current. The primary coil 8th and the secondary coil 14th can also be regarded as transformer halves, whereby the energy transfer can also be referred to as transformer energy transfer. The Electronic 15th can for example comprise a rectifier, a smoothing capacitor and a storage capacitor. The module 6th can through the communication facility 18th with the camera 9 exchange data wirelessly.

The trigger electronics 16 is set up to receive sensor data from the IMU 17th to receive, to determine a movement of the drawer (pull-out distance or position, speed and direction of movement) from the sensor data, and, if movement fulfills at least one predetermined criterion, via the communication device 18th at least one command (trigger) to the at least one camera 9 output for image acquisition.

3 shows a possible flow diagram for triggering at least one image by the camera 9 by means of the module 6th .

In a step S0, the trigger electronics 16 Measurement signals from the IMU 17th evaluated and thereby a movement of the basket 5 determined.

In step S1 it is determined whether the basket 5 has been extended by a specified (possibly adjustable) distance. If this is not the case ("N"), no trigger signal is sent to the camera 9 issued. However, an illuminance can then optionally be placed in the basket, for example 5 irradiated illuminating light can be increased, etc.

If this is the case (“Y”), a check is carried out in a step S2 or it is determined whether the basket 5 is inserted again. If this is not the case ("N"), no trigger signal is sent to the camera 9 issued.

If this is the case ("Y"), the trigger electronics give 16 a trigger signal to the camera in step S3 9 to trigger an image recording (a single image or a sequence of images, e.g. a video), possibly together with the triggering of a flash. Also the illuminance of the in the basket can then 5 irradiated illuminating light can be reduced again.

The measurement / trigger module 13th can be analogous to the measurement / trigger module 6th can be used. in contrast to the module 6th can the module 13th eg have a camera (not shown), then on the communication device 18th can be dispensed with. Also the module 13th can be supplied inductively with electrical energy, with the associated primary coil (not shown) at a suitable point in the area of the further cooling space 10 is arranged, for example at its front edge.

When using inductive energy transmission with primary and secondary coils, the pushed-in position of the drawer (basket 5 or drawer 11th ) can be recognized by the fact that current is then induced in the secondary coil, while this energy transfer breaks down even at small larger distances.

Electronics can too 15th to be set up from the on the secondary coil 14th Read out induced currents data, e.g. to adjust the minimum distance.

It goes without saying that the present invention is not restricted to the exemplary embodiment shown.

So can a camera 9 can additionally or alternatively also be arranged on a side wall of the cooling space (advantageously frontal in front of the shelves), on a front edge of a shelf and / or on an inside of the door.

In general, “a”, “one” etc. can be understood as a singular or plural number, in particular in the sense of “at least one” or “one or more” etc., as long as this is not explicitly excluded, for example by the expression “exactly a "etc.

List of reference symbols

1

Cooling device

2

Cold room

3

Loading opening

4th

Shelf

5

basket

6th

Measurement / trigger module

7th

Body

8th

Primary coil

9

camera

10

Another cold room

11th

Compartment drawer

12th

Drawer door

13th

Measurement / trigger module

14th

Secondary coil

15th

electronics

16

Trigger electronics

17th

IMU

18th

Communication facility

QUOTES INCLUDED IN THE DESCRIPTION

This list of the documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• EP 2995889 B1 [0002]
• EP 2998671 B1 [0003]
• EP 3040773 A1 [0004]

Claims (12)

Method (S0-S3) for taking pictures of an at least partially open drawer (5, 11) of a household refrigerator (1) by means of at least one camera (9), in which - A movement of the drawer (5, 11) is determined (S0) by means of an acceleration sensor (17) attached to the drawer (5, 11) and - At least one image of an interior of the drawer (5, 11) is recorded by means of the at least one camera (9) if the movement of the drawer (5, 11) fulfills at least one criterion (S1-S3). Procedure (S0-S3) according to Claim 1 , in which the acceleration sensor (17) is used to determine the distance by which the drawer (5, 11) is pulled out (S1) and at least one image of an interior of the drawer (5, 11) is recorded if the distance reaches a minimum distance or has exceeded. Method (S0-S3) according to one of the preceding claims, in which a direction of movement of the drawer (5, 11) is determined (S2) by means of the acceleration sensor (17) and at least one image of the interior of the drawer (5, 11) is recorded, when the drawer (5, 11) is pushed in (S3). Method (S0-S3) according to one of the preceding claims, in which at least one criterion is adapted automatically or by the user. Method (S0-S3) according to one of the preceding claims, in which at least one further action is triggered (S1, S3) if the movement of the drawer (5, 11) meets at least one criterion. Procedure (S0-S3) according to Claim 5 in which the at least one action is at least one action from the group - a change in an illuminance (S1, S3) that can be set to illuminate the drawer (5, 11), - a change in the light color of an illuminating light radiated into the drawer (5, 11) and - an automatic retraction and extension of the drawer (5, 11) is. Household refrigerator (1), having - A cooling space (2, 10) and at least one pull-out drawer (5, 11) accommodated in the cooling space (2, 10), - At least one camera (9) which is provided for recording at least one image of an interior space of the at least partially opened drawer (5, 11), - At least one acceleration sensor (17) and attached to the drawer (5, 11) - A trigger device (16) which is data-technically connected to the acceleration sensor (17) and the at least one camera (9) and which is set up to receive sensor data from the acceleration sensor (17) and to a movement of the drawer (5, 11) from the sensor data determine and, if movement fulfills at least one predetermined criterion, output at least one command to the at least one camera (9) for image recording. Household refrigerator (1) according to Claim 7 wherein the at least one acceleration sensor (17) and the trigger device (16) are integrated in a common module (6, 13) that can be fastened to the drawer (5, 11). Household refrigerator (1) according to Claim 8 , wherein the module (6, 13) is set up to be inductively supplied with current. Household refrigerator (1) according to Claim 8 , wherein the camera (9) is arranged at a distance from the module (6) and the module (6) comprises a communication device (18) for wireless communication with the camera (9). Household refrigerator (1) according to Claim 8 , wherein the camera is integrated in the module (13). Household refrigerator according to one of the Claims 8 until 11th , wherein the module (6, 13) is removably attached to the drawer (5, 11).

Images