DE102018213982A1 - Storage system and method for operating such a storage system - Google Patents

Abstract

A storage system (1) has a camera (6), a weight-sensing open CICO surface (11), a user interface (7, 8, S) and a database (5), the storage system being set up to detect objects on household goods (H) in images taken by the camera, to determine a weight of household goods (H) stored on the CICO surface, to inquire whether household goods (H) located on the CICO surface are added to storage or from storage If the household goods located on the CICO area are to be added to the storage, the household goods are to be entered in the database depending on the weight and if the household goods located on the CICO area are to be added from the storage, the household goods are weight-dependent from the database unsubscribe. A method (S1-S11) is used to operate a storage system (1). The invention is particularly advantageously applicable to the storage of food in a household, in particular with several storage locations, especially comprising at least one cold room of a household cooling device.

Description

The invention relates to a storage system, comprising a camera, a user interface and a database, the storage system being set up to carry out object detection on household goods in images recorded by the camera. The invention also relates to a method for operating or using such a storage system, in which object detection on household goods is carried out in images recorded by the camera. The invention is particularly advantageously applicable to the storage of food in a household, in particular with several storage locations, especially comprising at least one cold room of a household cooling device.

CN 106969593 discloses a food management method for a smart refrigerator, comprising: controlling a camera located outside a door of the refrigerator to take a picture of a target food and display the picture on a part of a display screen; Displaying a virtual memory pattern of the refrigerator on another part of the display screen; Accepting a command that a user drag the image of the target food to a first location in the virtual memory pattern; Displaying an ingredient input interface of the target food according to user selection and inputting and storing the food information; and complete the input of ingredients.

It is the object of the present invention to at least partially overcome the disadvantages of the prior art and, in particular, to provide a particularly user-friendly possibility for the effective storage of household goods.

This object is achieved in accordance with the features of the independent claims. Advantageous embodiments are the subject of the dependent claims, the description and the drawings.

• - eine Objekterkennung auf eine Art von Gütern in von der Kamera aufgenommenen Bildern durchzuführen,
• - ein Gewicht von auf der CICO-Fläche abgelegten Gütern zu bestimmen,
• - über die Nutzerschnittstelle abzufragen, ob auf der CICO-Fläche befindliche Güter zu einer Lagerhaltung hinzugefügt oder aus der Lagerhaltung ausgetragen werden sollen,
• - falls die auf der CICO-Fläche befindlichen Güter zu der Lagerhaltung hinzugefügt werden sollen, die Art der Güter gewichtsabhängig in die Datenbank einzutragen und
• - falls die auf der CICO-Fläche befindlichen Güter aus der Lagerhaltung hinzugefügt werden sollen, die Art der Güter gewichtsabhängig aus der Datenbank auszutragen.

The object is achieved by a storage system comprising a camera, a weight-sensing open CICO surface located in a field of view of the camera, a user interface and a database, the storage system being set up to

• perform object detection on a type of goods in images taken by the camera,
• - determine a weight of goods deposited on the CICO surface,
• - query via the user interface whether goods located on the CICO area should be added to a warehouse or removed from the warehouse,
• - If the goods on the CICO area are to be added to the storage, enter the type of goods in the database depending on the weight and
• - If the goods from the warehousing located on the CICO area are to be added, the type of goods must be entered in the database depending on the weight.

This storage system has the advantage that it enables a user in a particularly simple way to track household goods of any kind in a household and / or to monitor them in terms of storage. The household goods managed by the above storage system are not stored in a specific household appliance such as a refrigerator or the like. limited. In particular, the storage system makes it possible to automatically recognize or determine the type of household goods and their weight and to enter them into the storage system, which provides a particularly user-friendly option for the effective storage of household goods. The further advantage is achieved that this storage system enables a particularly quick and computationally effective option for the entry and removal of household goods.

A CICO (“Check In / Check Out”) area is understood to mean, in particular, an area on which a household item has to be placed in order to be recorded in terms of weight and image and then managed by the storage system. The CICO area can also be used as a registration / deregistration area or similar. be designated.

The fact that the CICO surface is a weight-sensing surface means that it corresponds to a weighing surface of a scale. The scale assigned to the CICO surface can in particular be designed as a thin weighing mat or “weighing pad”. The use of the CICO surface as a weight-sensing surface gives the advantage that household goods placed on the CICO surface can be identified and weighed at the same time by the camera, in particular also in an automatic identification process that can be carried out automatically.

The fact that the CICO area is an open area means in particular that the CICO area is not a fixed area defined within a household appliance. In this way, the CICO surface can be arranged or defined in a variety of ways in a household, regardless of the existence certain household appliances. It is fundamentally possible for the CICO surface to correspond to an openly accessible surface in a household, in particular in a kitchen, or to be housed in household furniture. The CICO surface or the associated scale can be fixed locally or can be variably positioned (mobile scale). The scale can be a network-compatible scale. For this purpose, the scale can have a wireless communication device, for example a Bluetooth and / or a Wi-Fi module, via which it can forward measurement data or data derived therefrom, for example to a control device of the storage system.

It is a further development that the CICO surface has a surface pattern that can be detected by the camera. This has the advantage that a size or volume of household goods placed on the CICO surface can also be determined by means of the camera.

The database can be integrated in a component of the storage system. Alternatively or additionally, the database can be integrated in a household appliance and / or in a household appliance control system. Alternatively or additionally, the database can be present in a network-compatible instance, for example in a mobile user terminal such as a smartphone, a tablet PC or the like, and / or in an instance external to the household, such as on a network server, in which so-called cloud, etc.

The storage system can have a central control device which controls or coordinates the CICO surface or the associated scale, the camera, the user interface and the database. The control device can be an independent device. Alternatively, a component of the storage system such as the user interface etc. can also serve as a control device. The control device can alternatively or additionally be provided by a household appliance (which itself can in turn be a component of the storage system), be provided in a non-household appliance such as a mobile user terminal (for example via an application program or "app") and / or be provided on a network basis , e.g. by means of a network server or from the so-called cloud.

A household good is in particular a consumer good that can be used or is typically used in a household, especially a food.

Object detection of household goods in pictures is generally known and will not be discussed further here. The detection of a household good can at least include a detection of its type (e.g. milk (with more precise detection e.g. fresh milk or non-perishable milk), butter, a type of fruit such as apples etc., a type of vegetable such as broccoli, a content of a preserve etc.) and possibly a detection other properties such as a manufacturer, a package size, storage instructions, a best before date, etc.

The fact that the storage system is set up to "record household goods in the database depending on weight" means in particular that the type and weight of at least one household item stored, recognized and weighed on the CICO area are added to the storage system by entry or storage in the database.

It is a further development that at least one further property of the recognized and weighed at least one household item is entered in the database, for example a date of expiry, storage information, dietary information, allergy information, etc.

If the household goods to be added already exist in the database, the currently weighed weight can be added to the weight of this household goods entered in the database. The quantity addition of a household good to be added to an existing household good can be carried out using at least one selection criterion, which includes at least one basic type of household good (e.g. milk), but can also include further properties of the household good, e.g. a more precise type of household goods (e.g. fresh milk or non-perishable milk), a manufacturer, etc.

The weight-dependent removal of the type of goods from the database can be carried out analogously to the entry described above. If the measured weight of a particular household item to be carried out is less than the weight entered in the database, the removal from the database can include subtracting the currently weighed weight from the weight entered in the database. The household goods remain stored in the database together with the remaining weight and possibly further information about this household goods or this type of household goods. If a household good is to be discharged with its entire weight, in a variant this household good with all its associated entries can be deleted from the database, or the weight can simply be set to zero.

The warehousing system is generally set up to detect objects, determine weight and / or query for at least one household item (ie for an individual item) Household goods, for several household goods in succession and / or for several household goods at the same time). The weight determination of several household goods can be carried out at the same time, for example, if the scale belonging to the CICO surface has the ability to measure the weight stored on the CICO surface in a location-resolving manner. For this purpose, the scale can have, for example, a field or array of several weight sensors. Such a spatially resolving weighing scale has the further advantage that it can be used to determine, at least roughly, a surface of a household item placed thereon and thus also its volume.

It is an embodiment that the storage system is set up to check the intended storage location of the household goods as being suitable for the household goods and to issue a note to a user at a storage location which is classified as unfavorable or unsuitable for the household goods. This has the advantage that storage locations which are unsuitable for a specific household good can be better avoided. An uncooled storage location may be classified as unsuitable for household goods to be cooled or perishable. The notice to the user can be output via the user interface of the storage system. This has the advantage that a user can change the storage location immediately.

The user interface is basically of any type and can e.g. a touch-sensitive screen or a screen / keyboard combination, a virtual user interface (e.g. comprising a light projector and 3D sensors for detecting finger positions), a voice-based user interface, a gesture-based user interface, etc., or any combination thereof. The user interface can be fixed locally (e.g. installed) or can be variably positioned. It is particularly advantageous for a particularly versatile positioning of the user interface if it has or is a light-based virtual user interface and / or a voice-controlled user interface.

The user interface can be an independent component of the storage system. Alternatively or additionally, the user interface can be provided by another entity such as a household appliance and / or a mobile user terminal.

It is an embodiment that the camera is integrated in a retrofit module together with an interface device for providing a light-based virtual user interface and / or a voice-controlled user interface and with a wireless communication device. This has the advantage that the camera can be variably positioned together with the user interface, for example also by an end user. A retrofit module is understood to mean, in particular, an independent module that can be subsequently installed or assembled. For this purpose, the retrofit module can be equipped with a holding device, e.g. a magnetic and / or mechanical holding device. The retrofit module also has an energy store in order to supply the electrically operated components of the retrofit module with current.

By means of the wireless communication device, the camera can wirelessly send images to a data processing device, by means of which the object recognition can be carried out. The data processing device can be a functional component of a control device of the storage system. Alternatively, the object recognition can also be carried out in the retrofit module, which then has a corresponding data processing device. The wireless communication device can also be used to receive data for controlling the user interface and to transmit user inputs carried out on the user interface, for example to a control direction of the storage system. The wireless communication device can be, for example, a Bluetooth and / or a Wi-Fi module.

Alternatively, at least one of the components of the retrofit module, or a built-in module analogous to the retrofit module, can be permanently installed, e.g. in a household appliance, for example an extractor hood or cooker.

It is an embodiment that the user interface is additionally set up as a user interface for household appliance control. A dedicated user interface for household appliance control can thus advantageously be dispensed with, which saves costs and storage space. A household appliance control can in particular be understood to mean a control for controlling one or more household appliances. The household appliance control system can be coupled to the storage system, for example in order to link a recipe-based preparation of food on at least one household appliance with foodstuffs that are available and are stored in the storage system. For example, if a user wants to create a certain recipe-based menu sequence, the inventory of food available for this purpose can be displayed to him using the storage system, a shopping list with missing food, etc. can be created.

• - eine Objekterkennung auf Haushaltsgüter in von der Kamera aufgenommenen Bildern durchgeführt wird
• - ein Gewicht von auf der CICO-Fläche abgelegten Haushaltsgütern bestimmt wird,
• - über die Nutzerschnittstelle abgefragt wird, ob auf der CICO-Fläche befindliche, erkannte Haushaltsgüter zu einer Lagerhaltung hinzugefügt oder aus der Lagerhaltung ausgetragen werden sollen,
• - falls die auf der CICO-Fläche befindlichen Haushaltsgüter zu der Lagerhaltung hinzugefügt werden sollen, die Haushaltsgüter gewichtsabhängig in die Datenbank einzutragen und
• - falls die auf der CICO-Fläche befindlichen Haushaltsgüter aus der Lagerhaltung hinzugefügt werden sollen, die Haushaltsgüter gewichtsabhängig aus der Datenbank auszutragen.

The object is also achieved by a method for using a storage system, comprising a camera, a weight-sensing open CICO surface located in a field of view of the camera, a user interface and a database, with the method

• - Object detection on household goods is carried out in images taken by the camera
• - a weight of household goods deposited on the CICO area is determined,
• - The user interface is used to query whether recognized household goods located on the CICO area are to be added to a storage facility or to be removed from the storage facility,
• - If the household goods on the CICO area are to be added to the storage, enter the household goods in the database depending on their weight and
• - If the household goods on the CICO area are to be added from storage, the household goods should be removed from the database depending on the weight.

The goods can be designed analogously to the storage system and have the same advantages.

It is an embodiment that consumption data is generated from the entries and withdrawals in or from the database. In this way, usage behavior of an entire household can be evaluated across all storage locations managed by the storage system, for example in relation to certain types of household goods, their distribution over time, etc.

The object is also achieved by a computer program product comprising code which, when it is carried out on a data processing device, carries out the method described above. The data processing device can be a computer unit such as a mobile user terminal, a household appliance, a server or a computer network such as the cloud.

The object is also achieved by a storage medium on which the code of the computer program product is stored.

• 1 zeigt in Frontansicht in teilweiser Schnittdarstellung ein Lagerhaltungssystem;
• 2 zeigt einen Ablauf eines Verfahrens zum Betreiben eines Lagerhaltungssystems;

The properties, features and advantages of this invention described above and the manner in which they are achieved can be more clearly understood in connection with the following schematic description of an exemplary embodiment, which is explained in more detail in connection with the drawings.

• 1 shows a front view in partial sectional view of a storage system;
• 2 shows a sequence of a method for operating a storage system;

1 shows in a partial sectional view, not to scale, a possible storage system 1 , having a retrofit module 2 , a mobile weighing mat 3 and a control device 4 with a database 5 , The retrofit module 2 is shown in more detail in the dotted circle.

The retrofit module 2 and the mobile weighing mat 3 are network-compatible, for example by being equipped with a wireless communication module 9 (e.g. a WiFi module, see 2 below), and through an internet access point like a WiFi router R with a computer network or the so-called "cloud" C connected.

The cloud C provides IT infrastructure such as computing power, the function of the control device 4 as application software and data storage for the provision of the database 5 ready on the internet. The function of the control device 4 can be a sub-function of a general control system for controlling household appliances, for example using the so-called "Home Connect". The cloud C can also be used as a data processing device for processing data from the storage system 1 serve, for example, to carry out object detection, reading out food-specific additional information such as storage instructions, dietary information, etc.

The services and functions of the cloud C for the storage system 1 provides or holds, can via a network-capable mobile user terminal S be accessed like a smartphone etc.

The retrofit module is present 2 on the underside of an extractor hood D attached, which is above one in a countertop A recessed hob K located. The retrofit module 2 has, for example, at least the following components: a camera 6 ; an interface device 7 to provide a light-based virtual user interface; an interface device 8th to provide a voice controlled user interface; a wireless communication device 9 in the form of a WiFi module; and an energy storage 10 ,

By means of the interface device 7 can a virtual user interface in the form of a virtual control panel 13 on a portion of a top of the worktop A be projected, here on a partial area next to the hob K , The interface device 7 has a light projector 7a to display a light pattern of the virtual control panel 13 on the worktop A on. The light projector 7a can have at least one LED or at least one laser as the light source. The interface device 7 also has at least one 3D sensor 7b for detecting finger positions on the by the light projector 7a generated light pattern. The 3D sensor 7b can include, for example, an ultrasonic sensor, an IR sensor, a camera, etc. Includes the 3D sensor 7b a camera, this can be one of the camera 6 be different camera or the camera 6 his.

The control device 4 can be set up, for example, by the light projector 7a Specify projected light patterns, for example to display a virtual control surface including at least one operating field and possibly a display field. The control device 4 can also from the at least one 3D sensor 7b Receive information about which at least one through the light projector 7a projected operating fields has been operated by a user.

The interface device 8th can be a microphone 8a and a speaker 8b exhibit. A voice evaluation from via the microphone 8a recorded voice and a voice output through the speaker 8b can for example by means of the control device 4 be made.

The retrofit module 2 can be attached to the extractor hood D (or any other object in principle) have at least one magnet (not shown), can be clamped on, e.g. glued on with double-sided adhesive tape, etc.

The energy storage 10 can have at least one single-use battery or at least one rechargeable battery.

The mobile weighing mat 3 can record weight in a further training in a location. The weighing mat 3 also points to their as CICO area 11 used top weighing surface on an optically evaluable pattern, which optical determination of objects placed on it, in particular household goods H , facilitated. The mobile weighing mat 3 also has a wireless communication module 9 eg in the form of a WiFi module and an energy storage 12 for supplying electrically operated components of the weighing mat 2 with electric current.

The camera 6 can take pictures of on the CICO area 11 stored objects, especially household goods H , take up. The camera 6 can use the CICO surface 11 automatically recognize (for example, based on the pattern applied to it and / or at least one typical identifier such as a barcode, QR code, etc.) and / or appropriately aligned by a user. The CICO area 11 is located next to the virtual control panel, for example 13 , but can basically be anywhere within a field of view of the camera 6 to be ordered.

The virtual control panel 13 can from the control device 4 also be designed so that it can be used to control (other) household appliances such as cooking appliances (e.g. cooktops K , Ovens, steamers, microwave ovens etc.), refrigerators (refrigerators etc.), dishwashers, laundry care devices (e.g. washing machines, tumble dryers etc.) and / or small household appliances (coffee machines, mixers, toasters etc.) can be used.

2 shows a possible sequence of a method for using the storage system 1 ,

In one step S1 using the 3D sensor 7b a user-side actuation of a corresponding actuation field of the virtual control panel 13 and / or by means of the microphone 8a an input of a voice command recognizes whether a user has at least one household good H into the database 5 of the storage system 1 want to register or deregister from it.

In one step S2 is from the camera 6 of the retrofit module 2 automatically or by recognizing a user actuation of a corresponding actuation field of the virtual control panel 13 and / or by recognizing a voice command, at least one image of the at least one household item H added.

In one step S3 the at least one image will be on the communication module 9 of the retrofit module 2 to the WiFi router R and from there to the cloud C transfer.

In one step S4 is in the cloud C , for example by means of the control device 4 or the associated function or by means of another through the cloud C provided data processing function, the at least one image subjected to object detection.

In one step S5 is by means of the weighing mat 3 a weight of the on the CICO surface 11 filed at least one household good H certainly. If there are several household goods H can - with appropriate location-determining weight-determining training of the weighing mat 3 - the weight of each of the household goods H be determined at the same time.

In one step S6 the at least one specific weight (with several weights together with the position of the weighed household goods H on the CICO area 11 via the communication module 9 the weighing mat 3 to the WiFi router R and from there to the cloud C transfer.

In an optional step S7 can the recognized household goods H and their weights are displayed to a user, for example via the display panel of the virtual control panel 13 , In one variant, a user can display the contents of at least one household good H add or change.

In an optional step S8 a user can specify which storage location the at least one on the CICO area 11 filed household goods H should be assigned or from which storage location the at least one household good H to be held. Optionally, the intended storage location of the household goods H than for the household goods H suitably checked and at one for the household goods H an indication to a user is given as an unfavorable or unsuitable storage location, for example via the display field of the virtual control panel 13 ,

If in step S1 it was recognized that a user has at least one household good H into the inventory system 1 want to enter, can be done in one step S9 at least data as entries of a common data record in the database 5 stored additively, e.g. one or more from the object recognition in step S4 and possibly from the user information from step S7 information obtained, at least including the type of recognized household goods H , its weight, possibly its specified storage location, etc. Further information determined from the object recognition and possibly the user information can be searched for, for example, additional information of the at least one household goods in at least one further database (“product database”) H include, for example, dietary information, ingredients, etc. Also through the object detection on a packaging of the household goods H Recognized expiry date, ingredients, etc. as additional information in the database 5 can be saved.

The storage system 1 can be a self-learning system, for example in which it recognizes objects for a specific household good H based on one of these household goods H associated user input refined. The storage system can also be enabled to include certain household goods by including user input H only to be recognized.

Become multiple household goods H weighed at the same time, their weights can be correlated by the weighing mat 3 recognized positions on the CICO surface 11 with the positions recognized by the object recognition on the CICO surface 11 be correlated with each other.

If in step S1 it was recognized that a user has at least one household good H from the inventory system 1 want to carry out, that will be in one step S10 Recognized via the object recognition and possibly via the user information and via the weighing mat 3 weighed at least one household good H removed from storage.

In one step S11 can from the entries and withdrawals of the database 5 Consumption data for the associated household are generated and, for example, on the mobile user terminal S are displayed. Basically known services of a storage system, such as the creation of an electronic shopping list, recipe management, durability monitoring, etc., can also be carried out via the mobile user terminal S be used.

If necessary, the above process steps can be carried out several times in succession.

The procedure S1 to S11 can as a computer program product 4a are present, the code which, if, for example, by the control device 4 and / or by the mobile user terminal S is carried out the procedure S1 to S11 performs. The computer program product 4a can also have multiple components of the inventory system 1 distributed, for example as sub or sub-programs.

For example, the control device 4 and / or the mobile user terminal S a storage medium 4b have or be coupled to such a storage medium on which the code of the computer program product 4a is saved. The storage medium too 4b can have multiple components of the inventory system 1 be distributed.

Of course, the present invention is not limited to the exemplary embodiment shown.

In general, the mobile user terminal can S in addition or as an alternative to the interfaces 7 and or 8th of the retrofit module 2 can be used as a user interface.

A camera of the mobile user terminal, which is typically present, can also be used S in addition or as an alternative to the camera 6 of the retrofit module 2 be used for image acquisition. So it is also possible that retrofit module 2 through a mobile user terminal S like replacing a smartphone, tablet pc, etc. The mobile user terminal S can then be held in a hand by a user to carry out the above method steps or held in a dedicated holder.

It is also possible to at least partially recognize the object by means of the mobile user terminal S perform. More generally, some or all of the in 1 than the cloud C associated functions, services and facilities of dedicated computing devices such as a dedicated network server or the mobile user terminal S be taken over.

They also need to know 2 process steps listed not to be carried out in the order specified.

So that in step S1 Described recording of a user request for entry into or removal from the database 5 be carried out after the household goods H recognized and weighed.

Furthermore, the determination of further information on a recognized household good H instead of step S9 in one of the steps S4 or S8 be performed. For example, this can be beneficial to step in S8 an entered storage location is particularly reliable as for a household good H suitable, conditionally suitable or unsuitable.

In general, one or more of the in 2 The procedural steps shown are carried out automatically or only after a user input, a user confirmation or a user check.

In general, "a", "a" etc. can be understood to mean a single number or a plurality, in particular in the sense of "at least one" or "one or more" etc., as long as this is not explicitly excluded, e.g. with the expression "exactly one" etc.

LIST OF REFERENCE NUMBERS

1

Inventory management system

2

Retrofit module

3

cradle mat

4

control device

4a

A computer program product

4b

storage medium

5

Database

6

camera

7

Interface device

7a

overhead projector

7b

3D sensor

8th

Interface device

8a

microphone

8b

speaker

9

communication module

10

energy storage

11

CICO area

12

energy storage

13

Virtual control panel

A

countertop

C

Cloud

D

Hood

H

household goods

K

hob

R

WiFi router

S

user terminal

S1-S11

steps

QUOTES INCLUDE IN THE DESCRIPTION

This list of documents listed by the applicant has been generated automatically and is only included for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• CN 106969593 [0002]

Claims (10)

Storage system (1), comprising a camera (6), a weight-sensing open CICO surface (11) located in a field of view of the camera (6), a user interface (7, 8, S) and a database (5), wherein the storage system (1) is set up to - to carry out an object detection on household goods (H) in images recorded by the camera (6), - determine a weight of household goods (H) deposited on the CICO surface (11), - query via the user interface (7, 8, 13; S) whether recognized household goods (H) located on the CICO surface (11) are to be added to a warehouse or removed from the warehouse, - If the household goods (H) located on the CICO area (11) are to be added to the storage, enter the household goods (H) into the database (5) depending on weight and - If the household goods (H) from the warehousing located on the CICO area (11) are to be added, the household goods (H) should be removed from the database (5) depending on the weight. Storage system (1) after Claim 1 The storage system (1) is set up so that when the household goods (H) located on the CICO surface (11) are to be added to a warehouse, a storage location of the household goods (H) to be added is queried and additionally in the database ( 5) to be entered. Storage system (1) after Claim 2 The storage system (1) is set up to check the intended storage location of the household goods (H) as being suitable for the household goods (H) and to give a note to a user at a storage location which is classified as unfavorable or unsuitable for the household goods (H) , Warehousing system (1) according to one of the preceding claims, wherein the user interface (7, 8, 13; S) has a light-based virtual user interface (7) and / or a voice-controlled user interface (8). Storage system (1) after Claim 4 The camera (6) together with the interface device (7) for providing a light-based virtual user interface and / or the voice-controlled interface (8) and with a wireless communication device (9) are integrated in a retrofit module (2). Storage system (1) according to one of the preceding claims, wherein the user interface (7, 8, 13; S) is additionally set up as a user interface for household appliance control. Method (S1-S11) for operating a storage system (1), comprising a camera (6), a weight-sensing open CICO surface (11) located in a field of view of the camera (6), a user interface (7, 8, 13 ; S) and a database (5), with the method - An object recognition on household goods (H) is carried out in pictures taken by the camera (6) - a weight of household goods (H) deposited on the CICO surface (11) is determined, - The user interface (7, 8, 13; S) asks whether recognized household goods (H) located on the CICO surface (11) should be added to a warehouse or removed from the warehouse, - If the household goods (H) located on the CICO area (11) are to be added to the storage, enter the household goods (H) into the database (5) depending on weight and - If the household goods (H) located on the CICO area (11) are to be added from storage, the household goods (H) should be removed from the database (5) depending on the weight. Procedure (S1-S11) according to Claim 7 , in which consumption data is generated from the entries and withdrawals from the database (5) (S11). Computer program product (4a), comprising code which, when it is carried out on a data processing device (4, S), the method according to one of the Claims 7 or 8th performs. Storage medium (4b) on which the code of the computer program product (4a) after Claim 9 is saved.

Images