IT202000007582A1 - Method and system for determining information relating to the filling of a dishwasher and for preparing a washing cycle of the dishwasher - Google Patents

Description

Method and system for determining information relating to filling a dishwasher and for preparing a wash cycle of the dishwasher

DESCRIPTION

TECHNOLOGICAL BACKGROUND OF THE INVENTION

Field of application.

The present invention generally relates to the technical field of preparing a washing cycle of a dishwashing machine, assisted by electronic processing, to support a user of the dishwashing machine.

Pi? in particular, the invention relates to a method, based on electronic processing, for determining information relating to the filling of a dishwasher.

Description of the known art.

A dishwashing machine (or more briefly a dishwasher), in particular household, typically comprises more? baskets (usually, an upper basket, a lower basket and a cutlery basket) in which to arrange the items to be washed.

Once the dishwasher has been filled and closed, the user sets a wash program or cycle, among a certain number of stored programs, or sets some variables of the wash cycle, and then commands the execution of the wash cycle.

In known solutions, the user acts through a dishwasher control interface, equipped for example with knobs or buttons, or through remote control with electronic devices.

In both cases, in the known solutions, the possibilities? offered by the dishwasher control interface to adapt the washing program to the actual dishwasher load situation are limited.

The user usually chooses the cycle to carry out on the basis of generic considerations, taking into account the generic information available to him about the load and the type of objects to be washed.

There? often leads to results that are not entirely satisfactory, in terms of quality? not optimal washing, the risk of damage to the objects pi? fragile, and with an unsatisfactory compromise between the different needs to thoroughly wash some heavy objects, and at the same time wash more? delicate but no less accurate other objects more? light or fragile or transparent.

? therefore, the need to assist the user in choosing a washing program suitable for the specific loading situation of the dishwasher is particularly felt.

This need, felt by many household appliances,? particularly critical for a dishwasher, in light of the very wide range of possible dishwasher loading conditions, which depend on numerous variables: the mix of types of objects that may be present, even very different from each other (for example, glass or plastic glasses , ceramic plates, metal pans or pots with metal or wooden handles, porcelain cups, metal cutlery, and so on); the different types of materials of the objects present (glass, plastic, metal, wood, ceramic, and so on); the division of the objects between the baskets and the arrangement within each basket; the load or fill conditions (for example, percentage of occupied volume).

Furthermore, even if there were software programs capable of identifying an optimal cycle given a certain load condition, the problem would remain of how to provide such a program as input with a? Description? accurate load situation, precisely because of the numerous variables that characterize this situation.

In fact, at the moment, there are no known solutions capable of obviating these problems and satisfying the aforementioned needs.

Consequently, the user needs, mentioned above, relating to quality are also unsatisfied. of washing, minimization of the risk of damage to objects pi? fragile, satisfactory compromise between different washing requirements for different types of loaded objects, and, last but not least, efficiency and energy saving of the washing cycle.

SUMMARY OF THE INVENTION

? purpose of the present invention is to provide a method for determining the filling information of a dishwashing machine, in particular domestic, which allows to at least partially obviate the drawbacks mentioned above with reference to the known art, and to respond to the aforementioned particularly felt requirements in the technical sector considered. Such purpose? achieved by a method according to claim 1.

Further embodiments of this method are defined by claims 2-25.

? It is also an object of the present invention to provide a method for preparing and executing a dishwashing cycle by means of a dishwashing machine, which is based on the results of the above method of determining filling information.

Such purpose? achieved by a method according to claim 26.

Further embodiments of this method are defined by claims 27-28.

Form also? object of the present invention is a system for preparing and carrying out a dishwashing cycle, capable of carrying out the above method. Such a system? defined in claim 29.

Further embodiments of the system are defined by claims 30-31.

Furthermore, ? a particular object of the present invention to assist a user in the choice of a washing program for the dishwasher, which takes into account the load situation, and / or in the optimization of the partition of the objects between the racks of the dishwasher, and / or in the optimization the arrangement of the objects inside each basket.

BRIEF DESCRIPTION OF THE DRAWINGS

Further characteristics and advantages of the methods and systems according to the invention will result from the following description of preferred embodiment examples, given as an indication and not of limitation, with reference to the attached figure, in which:

- Figure 1 schematically illustrates an embodiment of a system for the preparation and execution of a dishwashing cycle, according to the invention, capable of carrying out a corresponding embodiment of the method for the preparation and execution of dishes. a dishwashing cycle;

Figures 2 and 3 show examples of partitioning into sub-areas of the upper and lower baskets, respectively, according to an embodiment of the method according to the invention;

Figures 4-5 show two examples of tables for presenting the results obtained by carrying out an embodiment of the method for determining the filling information of a dishwashing machine;

- figure 6 represents an example of an arrangement of dishes, within a dishwasher basket, which the method according to the present invention? able to identify and describe;

Figure 7 shows a further example of a table for presenting the results obtained by carrying out an embodiment of the method for determining the filling information of a dishwashing machine;

Figure 8 schematically illustrates a graphical interface made available by a software application included in the present invention, corresponding to different steps of the method for the preparation and execution of a dishwashing cycle according to the invention.

DETAILED DESCRIPTION

With reference to Figures 1-8, a method for determining the filling information of a dishwashing machine 2, in particular domestic, is described.

The method comprises the steps of acquiring a digital color image of at least one basket 21, 22 of the dishwashing machine 2 containing items to be washed in a given condition of use; then, determining at least one information for filling the basket, as a function of the characteristics of the acquired digital color image; and then supplying to a user, by means of a graphic interface 32, the at least one specific basket filling information.

The aforementioned at least one basket filling information comprises a filling level, expressed in terms of volume, or percentage of volume, occupied in the basket, and / or one or more? of the following load condition information:

- volume, or percentage of volume, occupied in the basket, partitioned by article types belonging to a predefined set of article types; and / or

- volume, or percentage of volume, occupied in the drum, partitioned by types of material belonging to a predefined set of types of materials of which the items to be washed are made; and / or

- area or percentage of area occupied in the basket; and / or

- number of items to wash in the basket; and / or

- number of items to be washed in the basket divided by types of articles belonging to a predefined set of types of articles; and / or

- position occupied in the basket by each object present in the basket, according to a granularity? defined by a predetermined set of sub-areas of the basket; and / or - position of the cutlery basket, according to a granularity? defined by a predetermined set of sub-areas of the basket.

According to an embodiment of the method, the aforementioned acquisition step comprises acquiring a respective digital color image of each of at least two racks of the dishwashing machine 2, an upper rack 21 and a lower rack 22.

The determining step comprises determining for each of the at least two baskets 21, 22 the aforementioned at least one basket filling information, as a function of the characteristics of the respective acquired digital color image.

In accordance with an embodiment of the method, the above steps of determining and providing comprise determining and providing at least the filling level of the basket.

According to an implementation option, the aforementioned determining step comprises determining the filling level of the basket, and furthermore determining the following load condition information: the volume, or the percentage of volume, occupied in the basket, partitioned according to the aforementioned types of articles, and partitioned according to the aforementioned types of material; and the number of objects in the basket, for each of the aforementioned types of article, and for each of the aforementioned types of material.

According to an embodiment of the method, the step of determining comprises determining the filling level of the basket and all the previously mentioned loading condition information.

In accordance with one embodiment, the method further comprises determining the following additional load condition information:

- types of articles present in the basket, among a plurality? of types belonging to a predefined set of types of articles; and / or

- type of material of which the objects to be washed in the basket are made, among a plurality? of material types belonging to a predefined set of material types.

According to different possible implementation options of the method, the step of determining comprises determining the filling level of the basket and any combination of one or more? of the load condition information, previously mentioned.

According to an implementation option, the step of providing comprises providing the user with all or a desired subset of the fill level information and given load conditions.

In accordance with an embodiment of the method, the aforementioned step of determining at least one basket filling information comprises processing this digital image by means of a processing employing artificial intelligence and / or machine learning techniques. and / or at least a trained algorithm.

On the basis of this elaboration, the method foresees to recognize and / or determine, for each of the one or more? dishwasher baskets of which? The image, the aforementioned information on the filling level of the basket and / or the above information on the loading conditions has been acquired.

According to an embodiment of the method, the aforementioned processing employing artificial intelligence techniques and / or at least a trained algorithm? based on one or more? preliminary training phases, carried out before the operational phases described above.

Each preliminary training phase includes training an artificial intelligence algorithm and / or? Machine learning? to determine and / or recognize a predefined set of filling information, comprising one or more? the following information on fill level and / or load conditions:

- volume or percentage of volume occupied by the objects to be washed; and / or

- area or percentage of area occupied by the objects to be washed; and / or

- number of items to wash present; and / or

- types of articles present in the basket, among a plurality? of types belonging to a predefined set of types of articles; and / or

- volume or percentage of volume occupied in the partitioned basket for each of the identified article types; and / or

- number of items to be washed present, partitioned for each of the identified article types; and / or

- type of material of which the objects to be washed are made, among a plurality? of material types belonging to a predefined set of material types; and / or

- volume or percentage of volume occupied, partitioned for each type of material identified; and / or - number of objects present, partitioned for each type of material identified; and / or

- position occupied by each of the identified objects, according to a granularity? defined by a predetermined set of sub-areas of the basket and / or

- position of the cutlery basket, according to a granularity defined by a predetermined set of sub-areas of the basket;

The aforementioned stage of training includes acquiring a plurality? of digital color images of a basket, each corresponding to a known load condition of the basket, in which? known the value of and / or content of each of the information belonging to the aforementioned predefined set of filling information to be determined.

The artificial intelligence algorithm and / or? Machine learning? is then trained on the basis of plurality? of digital color images acquired and on the basis of the respective values and / or known contents of each of the filling information to be determined, corresponding to the respective known conditions of loading of the basket represented by the respective digital color images acquired.

According to various possible implementation options, the phase of acquiring a plurality? of images in the training phase includes acquiring different images in different lighting and / or shooting conditions (with or without flash), and / or in the presence of different disturbances that could occur in real situations, and / or with different resolutions compatible with different possible means of acquiring the image of the user, in order to train the artificial intelligence algorithm and / or? machine learning? to recognize the desired information in a plurality? of corresponding real situations of acquisition of images by the user.

According to another implementation option, combinable with the previous one, the phase of acquiring a plurality of of images in the training phase includes acquiring images in which portions or fractions of one or more? objects placed in a dishwasher basket, and not the entire objects, in order to train the artificial intelligence algorithm and / or? machine learning? to recognize an object even when it is filmed even only partially and / or when only a portion of the object is filmed.

It should be noted that the method described here therefore provides for a recognition, even in the aforementioned non-optimal conditions, on the basis of only training the algorithm (and without requiring the user to take more images and compare them).

Also note that the method can? employ different algorithms or techniques of artificial intelligence and / or? machine learning ?, per se? notes, for the recognition of objects, which are nevertheless trained in the specific ways previously illustrated.

According to some implementation examples of the method, the training phase is carried out by dividing the set of digital images acquired under known filling conditions into two subsets, a training subset and a test subset. The results gradually obtained by the algorithm trained on the basis of the training subset are verified by means of the test subset, in order to validate the results obtained, obtain and evaluate the performance metrics, evaluate the percentage of error obtainable from the estimates, and eventually refine the training with additional training images.

Typically, there? involves the acquisition of several hundreds, or even thousands of digital images, acquired under respective known conditions, during the training phase of the algorithm.

In an actually implemented training example, 338 images were employed to constitute a subset of tests.

For the training subset, 1869 color photographs were taken (digital images acquired for training purposes), of which 754 in ambient light with flash, 753 in ambient light without flash, 362 without ambient light with flash .

The known load conditions, for each acquired image, have been prepared by arranging in the most suitable ways? different, in the upper and lower basket of the dishwasher, a plurality of of commercial objects with fully known characteristics, in particular volume and material.

The structural characteristics, in particular the dimensions, of the upper and lower baskets of the considered dishwasher, have been provided to the algorithm as a training input.

The actions illustrated above can of course be repeated on a plurality of of different dishwashing machines.

The photographs were taken from a reference position considered typical for the user (for example, at the height of the sternum of a 170 cm tall person and at a distance of 20 or 30 cm from the fully open dishwasher door).

According to an implementation option of the method, the results of the trained algorithm are combined with deterministic algorithms or formulas.

For example, the trained algorithm can? be used to identify the types of objects and the respective types of material present in the basket, the number of objects and their position.

In this case, the method also includes the step of estimating the volume and / or the percentage of volume occupied in the basket, and / or the volume and / or the percentage of volume occupied in the basket, partitioned by type of material and by type of object. , and / or the basket occupation area, on the basis of the results provided by the trained algorithm elaborated by means of formulas and / or analytical algorithms, on the basis of mathematical relations and / or predefined criteria.

According to an implementation option, the preliminary training phase includes defining a set of categories of recognizable objects, each category being defined by the type of item to be washed and the type of material of the item to be washed; then, associate a respective estimated volume to each category; then, to train the recognition algorithm to recognize the category of an object included in an acquired image, by means of a training carried out on the basis of a plurality of objects. of acquired test color images, corresponding to respective situations of known filling of the basket, in which objects of known category and of known volume and shape are placed in the basket.

In this case, the phase of determining comprises identifying the number of objects present in the basket and recognizing the category of each object, by means of a processing of the acquired color image carried out by the trained algorithm; and estimate the total volume occupied by the objects present on the basis of the number of objects identified and the respective types recognized.

The volume for each category is estimated using an approximate default value dictated by experience, or it is calculated on the basis of approximate rules or formulas established a priori based on experience.

In accordance with an implementation option, the aforesaid phase of determining further comprises estimating the volume occupied by each category of object identified as the product of the number of objects identified belonging to the category and the predefined volume associated with the category; and estimate the total volume occupied in the basket as the sum of the estimated volumes for each category of objects identified.

According to an implementation option, the aforesaid step of determining further comprises estimating a percentage of occupied volume as a ratio between the total volume occupied in the estimated basket and a known volume value of the basket.

In various possible implementation variants of the method, algorithmic techniques are used aimed at reaching a reasonable and effective compromise between the accuracy of the estimates and the complexity? algorithms and related training.

Taking into account that, for the purposes of the present invention,? a reasonable approximation in the estimate, for example, of the volumes of the objects to be washed, is acceptable, in order to simplify the algorithms, in the face of the many different situations that can characterize a load condition (numerous categories of products, numerous sub-categories for each category , numerous possible arrangements of the items to be washed, etc.).

For example, once an object has been recognized, the volume estimate is obtained by applying different weights to standard volume values of the object, depending on whether the object has been placed by the user in the lower or upper basket.

The weights are predefined in the light of experience, taking into account the usual dispositions chosen by the users, for example the fact that objects more? bulky are usually placed in the lower basket.

Therefore, for example, a metal pot in the upper basket is associated with a lower weight, and therefore estimated with a lower occupied volume, compared to a metal pot placed in the lower basket.

Similar considerations apply to dishes or other crockery.

According to various possible implementation options of the method, the aforementioned predefined set of recognizable article types includes one or more? of the following types: glasses and / or crystals with stems and / or plates and / or pots and / or trays and / or cups and / or cutlery and / or utensils and / or other crockery.

In accordance with various possible embodiment options of the method, the aforementioned predefined set of recognizable types of materials comprises one or more? of the following types: glass and / or ceramic / porcelain and / or metals and / or plastic / silicone and / or wood and / or other material.

According to an implementation option of the method, for each of said recognizable types of article, a further recognition is made to identify the belonging of the object to a respective codified subtype.

In accordance with an embodiment, the method further comprises the steps of identifying the number of objects present in the basket and recognizing, for each object, the respective type and type of material, by means of a processing of the acquired color image.

In this case, the determining step includes determining, for each pair? Type of article? type of material ?, one or more? of the following information: volume or percentage of volume occupied in the basket and / or area or percentage of area occupied in the basket; and / or number of items to be washed in the basket; and / or position occupied in the basket defined by a predetermined set of sub-areas of the basket.

According to an implementation option, the supply phase includes providing information organized in a two-dimensional matrix, in which each column includes a respective type of article, among a predefined set of types of article, and each row includes a type of material, between a predefined set of material types, and in which a cell of the matrix contains as a result, for the respective pair? type of article? type of material ?, one or more? of the following determined information: volume or percentage of volume occupied in the basket; and / or area or percentage of area occupied in the basket; and / or number of items to be washed in the basket; and / or position occupied in the basket defined by a predetermined set of sub-areas of the basket.

According to a particular implementation option, the aforementioned matrix? a simplified matrix, capable of providing results only on the cells corresponding to combinations? type of article? type of material? predefined as significant.

According to an embodiment of the method,? recognition of the position of each object in a dishwasher basket is provided.

Furthermore, the aforementioned predetermined set of sub-areas of the basket which defines a granularity? of identifiable position comprises: for the upper rack 21 of the dishwasher a first number of sub-areas of the upper rack; for the lower rack 22 of the dishwasher a second number of lower rack sub-areas.

If so, the position of each object? expressed by indicating the sub-area of the lower or upper basket in which the object is identified.

According to an implementation option (illustrated in figure 2), three sub-areas of the upper basket (SA1, SA2, SA3) are defined for the upper basket of the dishwasher 21, arranged side by side with respect to each other along a length. of the upper basket, each corresponding to about one third of the width of the basket.

According to an implementation option (illustrated in Figure 3), three lower basket sub-areas are defined for the lower basket 22, comprising: a first lower basket sub-area SA6 which extends along the entire length of the lower basket and occupies a first half? the width of the lower basket; a second sub-area of the lower basket SA4 which occupies a part of the second half? of the width of the lower basket and extends for about two thirds of the length of the lower basket; a third sub-area of the lower basket SA5 which occupies the remaining part of the second half? the width of the lower basket and extends approximately one third of the length of the lower basket.

According to an implementation option, sub-area matrices are provided as a result, containing the information of the filling level and load condition considered, expressed for each sub-area.

Examples of such sub-area matrices are shown in Figures 4 and 5, where the determined and presented results are, respectively, the occupied volume and the number of objects, for each sensible combination? Type of object - type of material ?, within a sub-area.

Note that, in figure 5, even the number of objects can? assume a decimal value, therefore not an integer. There? ? linked to another interesting aspect of the method, namely? the capacity? to also identify the position of an object that is partly in a sub-area and partly in another sub-area, also attributing the object fractions to the relevant sub-area. Such a situation? illustrated for example in Figure 6.

Some details, purely illustrative and not limitative, will be reported below on the possible volumetric approximations adopted (in a particular implementation example) during the training phase. In this step, volumetric or dimensional or functional information of each of the objects arranged in the dishwasher is known. After the algorithm has recognized an object, an approximate volume is attributed to that object according to some criteria, exemplified below.

In these examples, three general criteria are adopted: a) objects having a shape similar to a cylinder, of which diameter and height are known, are attributed the volume of the cylinder having such diameter and height; b) to objects of a shape similar to a parallelepiped, of which the three dimensions are known, or of which two dimensions and the third are known? reasonably estimated, the volume of the parallelepiped having such dimensions is attributed;

c) for objects of which? note the capacity, the volume is estimated on the basis of the capacity? (converted, for example, from cl or l to cm <3>).

For objects that can be separated in pi? parts (e.g. pan and handle, or pot and handle, or cup and saucer), the overall volume is estimated as the sum of the estimated volumes for the individual parts.

For a lid, the volume is estimated based on the diameter of the relevant pot and an estimated thickness (e.g. 0.5cm).

For glasses, cups and trays, a volume estimate based on capacity is adopted.

For dinner plates and soup plates, can? be adopted an estimate based on the cylindrical approximation, that is? on the basis of the known diameter and of an estimated height on the basis of average height values for flat and deep plates.

For containers, can? be adopted an estimate based on the parallelepiped approximation, that is? as a product of the three dimensions.

For the cutlery, can you? be adopted an estimate based on the parallelepiped approximation, that is? as a product of the three dimensions, if known, or as a product of two known dimensions for an estimate of the third dimension; and so? Street.

An example of the results of the volumetric approximation illustrated above (and the standard deviations of the error committed, where available, enclosed in brackets)? reported in the matrix of figure 7, which shows the estimated volume, for a given filling condition in a dishwasher basket, for each significant pair? type of object - type of material ?.

An analogous type matrix can? also be presented in the operational phase, after the estimate has been made, based on the processing of an image acquired in a given situation. The estimate of the volume can? be done on the basis of approximations such as those reported above, or can? be calculated by attributing each object to a category, and adding known and predefined standard values for each category; if so, greater? the number of categories considered, therefore more? end ? the classification of objects, is it better? the approximation obtained.

In accordance with an embodiment of the method, the determining step further comprises determining indications and / or suggestions regarding the arrangement of the objects in the dishwasher, on the basis of the fill level and load information detected by processing the image. digital acquired.

In this case, the step of providing information to the user comprises: presenting the detected information in numerical or graphical form, including the aforementioned obtainable information on the level of filling of the basket and information on the load condition of the basket; and / or also provide written warnings to the user containing the aforementioned indications and / or suggestions regarding the arrangement of the objects in the dishwasher.

According to various embodiments, the processing that allows to reach these indications / suggestions for the user comprises predefined conversion tables on the basis of the percentage of types of objects among the known cycle programs.

The suggestions for the arrangement of the objects include indications of moving objects identified in an inappropriate basket, or in an inappropriate position inside a basket; and / or suggestions to arrange differently for some objects to improve a load balancing, if imbalances are detected, on the basis of predefined evaluation criteria (and incorporated in the algorithm); or even advice on efficiency, in terms of optimum load with respect to the percentage of filling, on the basis of known criteria of operating efficiency of the dishwashing machine.

According to a pi? specific implementation example, the aforementioned indications and / or suggestions provided to the user include an indication of optimization of the load between the upper basket and the lower basket of the dishwasher and suggestions for moving objects from one basket to the other; and / or an indication of optimizing the position of objects within a basket and suggestions for moving objects between different sub-areas of a basket.

According to an embodiment of the method, the steps of acquiring a digital color image and providing information to the user are carried out by means of a portable electronic device 3 equipped with digital image acquisition means 31 and a graphic interface 32. , on the basis of a software application and / or program memorized and executable in electronic processing means 30 of the portable electronic device 3.

According to an embodiment of the method, the step of determining at least one information of the filling level of the basket and / or of the load condition of the basket is carried out by means of a processing carried out by one or more? remote software programs stored and executed in remote electronic processing media 4.

The remote electronic processing means 4 are operatively connected with the electronic processing means 30 of the portable electronic device 3, and the aforesaid one or more? Remote software programs are interoperable with the application and / or software program stored and executable in the portable electronic device.

A method for preparing and carrying out a dishwashing cycle by means of a dishwashing machine 2, in particular domestic, is now described.

This method comprises the steps of providing a dishwashing machine 2; then, arranging the dishes in the baskets 21, 22 of the dishwashing machine; then, carrying out a method for determining filling information of a dishwashing machine according to any of the embodiments described above; in addition, define a recommended washing program, based on the results of the method for determining fill information.

The method then provides for generating a washing preparation notice, which can be consulted by the user, in which this washing preparation notice contains at least one washing instruction, comprising washing parameters of the recommended washing program and in addition one or more washing instructions. requests for confirmation and / or auxiliary wash preparation advice in addition to the aforementioned washing instruction.

The step of providing information to the user comprises providing the user with the aforementioned wash preparation notice, in addition to information about the filling level of the baskets and the loading condition of the baskets.

According to an embodiment, this method further comprises the steps of requesting from the user a validation of the generated washing instruction, in which the validation comprises an intentional confirmation or modification of the generated washing instruction and an intentional confirmation to start the cycle. dishwashing cycle according to the generated or modified washing instructions.

Finally, there are the steps of transmitting (S10) the aforementioned washing instruction generated or modified to a? Unit? control unit 20 of the dishwashing machine 2, and to carry out the washing cycle by means of the dishwashing machine 2, controlling the operation of the dishwashing machine by means of the unit? control unit 20 according to the washing instruction generated or modified, transmitted.

According to two different possible implementation variants, the step of transmitting the generated or modified washing instruction to a? Unit? electronic control of the dishwashing machine is carried out by means of a transmission of electronic signals and bypassing a user interface of the dishwashing machine 23 for the manual selection of washing parameters, or by means of a manual command via the user interface of the dishwashing machine 23.

According to an implementing example, the transmission of the washing instruction to the electronic control means of the dishwashing machine 20 takes place by means of a wireless signal connection between the portable electronic device 3 and the electronic control means of the dishwashing machine 20.

With reference to Figure 1, a system for preparing and carrying out a dishwashing cycle 1 is now described.

This system 1 comprises a dishwashing machine 2, a portable electronic device 3, and remote electronic processing means 4.

The dishwasher machine 2? configured to perform a dishwashing cycle, and includes a? unit? electronic control of the dishwasher 20, configured to control the execution of a washing program associated with the aforesaid washing cycle, on the basis of at least one washing instruction received.

The portable electronic device 3 comprises digital image acquisition means 31, configured to acquire a digital color image of at least one basket 21, 22 of the dishwashing machine containing items to be washed in a condition of use, and also processing means handheld electronic device electronics 30 and a handheld electronic device graphical interface 32.

Such a graphical interface 32? configured to provide a user with at least one drum fill information and / or a wash preparation notice containing at least one wash instruction relating to a suggested wash program; and / or at least a confirmation request and / or auxiliary wash preparation advice in addition to the wash instruction.

The remote electronic processing means 4 are operatively connected to the portable electronic device 3, and are configured to receive (S7) from the portable electronic device digital data corresponding to the acquired digital image; then, determine at least one drum filling information and / or a recommended washing program and / or auxiliary washing preparation recommendations, based on a digital color image processing, carried out by one or more? remote software programs stored and executed in the remote electronic processing means 4; and transmitting (S8) to the portable electronic device 3 the at least one drum filling information and / or the recommended washing program and / or the auxiliary washing preparation recommendations determined.

The aforementioned electronic processing means of the portable electronic device 30 are configured to perform, by means of an application and / or device software program, the following steps:

- prepare a presentation to the user of at least one basket filling information and / or recommended washing program and / or specific auxiliary washing preparation recommendations;

- receive instructions (S9) from the user to validate at least one specific washing instruction, corresponding to the recommended washing cycle which? determined, or a washing instruction modified by the user.

The aforementioned at least one basket filling information comprises a filling level, expressed in terms of volume, or percentage of volume, occupied in the basket, and / or one or more? of the following load condition information:

volume, or percentage of volume, occupied in the basket, partitioned by article types belonging to a predefined set of article types; and / or volume, or percentage of volume, occupied in the drum, partitioned by types of material belonging to a predefined set of types of materials of which the items to be washed are made; and / or area or percentage of area occupied in the basket; and / or number of items to be washed in the basket; and / or number of objects to be washed in the basket divided by types of articles belonging to a predefined set of types of articles; and / or position occupied in the basket by each object present in the basket, according to a granularity? defined by a predetermined set of sub-areas of the basket; and / or position of the cutlery basket, according to a granularity? defined by a predetermined set of sub-areas of the basket.

According to an embodiment of the system, the electronic processing means of the portable electronic device 30 are also configured to transmit (S10) the aforementioned washing instruction determined, or modified by the user, to the unit? electronic control panel of the dishwasher 20.

According to an implementation option, the step of transmitting (S10) is carried out by means of a transmission of electronic signals and bypassing a user interface of the dishwasher 23 for the manual selection of washing parameters.

According to another implementation option, the command to the dishwasher is carried out by means of a manual command via the user interface of the dishwasher 23.

According to an embodiment of the system, the aforementioned portable electronic device 3? a smartphone or tablet, equipped with a digital camera 31, and in which? memorized the aforementioned application or software program of a portable electronic device, executable by the processing means 30 of the smartphone or tablet.

Figure 8 illustrates an example of using a smartphone 3 as a portable electronic device in the context of the method described here, showing the screens of a graphical interface 32 controlled by the software application that supports the method, installed and executable in the smartphone 3, in relation to different steps of the method:

S1 acquisition of a color photograph of the upper basket of the dishwasher;

S2 acquisition of a color photograph of the lower basket of the dishwasher;

S3 through the graphic interface 32, the filling level, or percentage of load, of each of the baskets is indicated;

S4 by means of the graphic interface 32, a movement of some objects from the upper basket to the lower one, or vice versa, is suggested to optimize the load; S5 through the graphic interface, the movement of objects inside each of the baskets is suggested, to optimize the position of the objects, and to obtain better washing performance;

S6 by means of the graphic interface 32, an indication is provided on the washing program to be set, in light of the particular load condition identified.

In accordance with an implementation option, the aforementioned device software application? configured to present to the user a guide mask, superimposed on the frame of the dishwasher basket, before the image acquisition, to assist the user, aiming to optimize the recovery and acquisition of the image.

According to various possible implementation options, system 1? configured to carry out a method for preparing and carrying out a dishwashing cycle by means of a dishwashing machine 2, according to any one of the embodiments of this method, previously illustrated.

How can you? ascertain, the purpose of the present invention? fully achieved by the methods and system illustrated above, in virt? their functional and structural characteristics.

In fact, the method according to the invention allows to assist a user in the choice of a washing program for the dishwasher, with presentation of information, advice and suggestions that take into account the load situation, and / or the optimization of the partition of the objects. between the dishwasher baskets, and / or the optimization of the arrangement of objects inside each basket.

The information, the washing cycle recommendations and the suggestions provided to the user are determined by a processing that receives in input exhaustive information about the filling level and the load condition of the real situation preceding a specific washing cycle.

Such input information, determined on the basis of an artificial intelligence processing of one or more? digital images acquired, include information relating to a vast plurality? of variables, such as the mix of types of objects that may be present, even very different from each other (for example, glass or plastic glasses, ceramic plates, metal pans or pots with metal or wooden handles, porcelain cups, metal cutlery, and so on); the different types of materials of the objects present (glass, plastic, metal, wood, ceramic, and so on); the division of the objects between the baskets and the arrangement within each basket; the load or fill conditions (for example, percentage of occupied volume).

The availability? of this information on numerous relevant variables allows to effectively describe (albeit with reasonable approximations, appropriate to the type of application considered) the very wide range of possible loading conditions of the dishwasher.

Ultimately, the method and the system of the invention allow to satisfy the needs of the users, to whom you? previously mentioned, relating to quality? of washing, minimization of the risk of damage to objects pi? fragile, satisfactory compromise between different washing requirements for different types of loaded objects, and, last but not least, efficiency and energy saving of the washing cycle.

To the embodiments of the methods and systems described above, a person skilled in the art, in order to meet contingent needs, can? make changes, adaptations and replacements of elements with functionally equivalent ones, without departing from the scope of the following claims. Each of the features described as belonging to a possible embodiment can be be made independently of the other embodiments described.

LEGEND

FIG. 8

? Take a picture of the UPPER basket? =? Take a picture of the TOP basket?

? Now snap the LOWER basket? =? Now take (a photo) on the LOWER basket?

? Here? S how you? Ve loaded the basket? =? How did you load the basket?

? Everything in its proper place !? =? Everything in the right place !?

? And now, let? S wash !? =? And now, let's proceed with the washing !?

Claims (31)

CLAIMS 1. Method for determining filling information of a dishwashing machine (2), in particular domestic, comprising: ? acquiring a digital color image of at least one basket (21, 22) of the dishwashing machine (2) containing items to be washed in a given condition of use; - determine at least one information for filling the basket, according to the characteristics of the acquired digital color image; - provide a user, through a graphic interface (32), called at least one basket filling information, wherein said at least one basket filling information comprises: - a filling level, expressed in terms of volume, or percentage of volume, occupied in the basket, and / or one or more? of the following load condition information: - volume, or percentage of volume, occupied in the basket, partitioned by article types belonging to a predefined set of article types; and / or - volume, or percentage of volume, occupied in the drum, partitioned by types of material belonging to a predefined set of types of materials of which the items to be washed are made; and / or - area or percentage of area occupied in the basket; and / or - number of items to wash in the basket; and / or - number of items to be washed in the basket divided by types of articles belonging to a predefined set of types of articles; and / or - position occupied in the basket by each object present in the basket, according to a granularity? defined by a predetermined set of sub-areas of the basket; and / or - position of the cutlery basket, according to a granularity? defined by a predetermined set of sub-areas of the basket. Method according to claim 1, wherein said step of acquiring comprises acquiring a respective digital color image of each of at least two of said baskets (21, 22) of the dishwashing machine, an upper basket (21) and a lower basket ( 22); and in which said determining step comprises determining for each of the at least two said baskets at least one basket filling information, as a function of characteristics of the respective acquired digital color image. Method according to any one of the preceding claims, wherein said determining and providing steps comprise determining and providing at least said basket fill level. The method according to claim 3, wherein said determining step comprises determining the filling level of the basket, and furthermore the following loading condition information: - the volume, or the percentage of volume, occupied in the basket, partitioned according to said types of articles, and partitioned according to said types of material; And - the number of objects present in the basket, for each of said types of article, and for each of said types of material. Method according to any one of the preceding claims, wherein said determining step comprises determining said basket filling level and all of the aforementioned loading condition information. Method according to any one of the preceding claims, further comprising determining the following additional load condition information: - types of articles present in the basket, among a plurality? of types belonging to a predefined set of types of articles; and / or - type of material of which the objects to be washed in the basket are made, among a plurality? of material types belonging to a predefined set of material types. Method according to any one of the preceding claims, wherein the step of providing comprises providing the user with all or a desired subset of the specified fill level and load condition information. Method according to any one of the preceding claims, wherein said determining step comprises: - processing said digital image by means of a processing employing artificial intelligence and / or machine learning techniques. and / or at least one trained algorithm; - recognize and / or determine, on the basis of said processing, for each of the one or more? dishwasher baskets of which? the image, said basket fill level information and / or said load condition information has been acquired. Method according to claim 8, wherein said processing employing artificial intelligence techniques and / or at least one trained algorithm? based on one or more? preliminary training phases, carried out prior to the phases included in claim 1, in which each preliminary training phase includes: - train an artificial intelligence algorithm and / or? machine learning? to determine and / or recognize a predefined set of filling information, comprising one or more? the following information on fill level and / or load conditions: - volume or percentage of volume occupied by the objects to be washed; and / or - area or percentage of area occupied by the objects to be washed; and / or - number of items to wash present; and / or - types of articles present in the basket, among a plurality? of types belonging to a predefined set of types of articles; and / or - volume or percentage of volume occupied in the partitioned basket for each of the identified article types; and / or - number of items to be washed present, partitioned for each of the identified article types; and / or - type of material of which the objects to be washed are made, among a plurality? of material types belonging to a predefined set of material types; and / or - volume or percentage of volume occupied, partitioned for each type of material identified; and / or - number of objects present, partitioned for each type of material identified; and / or - position occupied by each of the identified objects, according to a granularity? defined by a predetermined set of sub-areas of the basket and / or - position of the cutlery basket, according to a granularity defined by a predetermined set of sub-areas of the basket; wherein said stage of training comprises; - acquire a plurality? of digital color images of a basket, each corresponding to a known load condition of the basket, in which? known the value of and / or content of each of the information belonging to said predefined set of filling information to be determined; - train the artificial intelligence algorithm and / or? machine learning? on the basis of said plurality? of digital color images acquired and on the basis of the respective values and / or known contents of each of the filling information to be determined, corresponding to the respective known conditions of loading of the basket represented by the respective digital color images acquired. Method according to claim 9, wherein the step of acquiring a plurality of of images in the training phase includes: - acquire different images in different lighting and / or shooting conditions, and / or in the presence of different disturbances that could occur in real situations; and / or - acquire images with different resolutions compatible with different possible means of user image acquisition, in order to train the artificial intelligence algorithm and / or? machine learning? to recognize the desired information in a plurality? of corresponding real situations. Method according to claim 9 or claim 10, wherein the step of acquiring a plurality of of images in the training phase includes: - acquire images in which portions or fractions of one or more are captured? items placed in a dishwasher basket, and not entire items, in order to train the artificial intelligence algorithm and / or? machine learning? to recognize an object even when it is filmed even only partially and / or when only a portion of the object is filmed. Method according to any one of claims 8 to 11, in which the trained algorithm is used to identify the types of objects and the respective types of material present in the basket, and also the number of objects and the position of each object; and in which the method further comprises the step of estimating the volume and / or the percentage of volume occupied in the basket, and / or the volume and / or the percentage of volume occupied in the basket partitioned by type of material and by type of object, and / or the basket occupation area on the basis of the results provided by the trained algorithm elaborated by means of formulas and / or analytical algorithms, on the basis of mathematical relations and / or predefined criteria. Method according to any one of claims 9 to 12, wherein the preliminary training phase comprises: - define a set of categories of recognizable objects, each category being defined by the type of article to be washed and the type of material of the article to be washed; - associate a respective estimated volume to each category; - train the recognition algorithm to recognize the category of an object included in an acquired image, by means of a training carried out on the basis of a plurality of of acquired test color images, corresponding to respective situations of known filling of the basket, in which objects of known category and of known volume and shape are placed in the basket; and in which the determining step includes: - identify the number of objects in the basket and recognize the category of each object, by means of a processing of the acquired color image carried out by the trained algorithm; - estimate the total volume occupied by the objects present on the basis of the number of objects identified and the respective recognized types. The method according to claim 13, wherein said determining step further comprises: - estimate the volume occupied by each category of object identified as the product of the number of objects identified belonging to said category and the default volume associated with said category; - estimate the total volume occupied in the basket as the sum of the estimated volumes for each category of objects identified. Method according to any one of the preceding claims, wherein said predefined set of recognizable article types comprises one or more? of the following types: glasses and / or crystals with stems and / or plates and / or pots and / or pans and / or cups and / or cutlery and / or utensils and / or other crockery. and wherein said predefined set of recognizable material types comprises one or more? of the following types: glass and / or ceramic / porcelain and / or metals and / or plastic / silicone and / or wood and / or other material. Method according to any one of the preceding claims, in which for each of said recognizable types of article, a further recognition is made to identify the belonging of the object to a respective codified sub-type. Method according to any one of the preceding claims, further comprising the steps of: - identify the number of objects in the basket and recognize, for each object, the respective type and type of material, by processing the acquired color image; and in which the determining phase includes determining, for each pair? type of article? type of material ?, one or more? of the following information: - volume or percentage of volume occupied in the basket; and / or - area or percentage of area occupied in the basket; and / or - number of items to be washed in the basket; and / or - position occupied in the basket defined by a predetermined set of sub-areas of the basket. 18. Method according to claim 17, in which the step of providing comprises providing information organized in a two-dimensional matrix, in which each column comprises a respective type of article, among a predefined set of types of article, and each row comprises a type of material, among a predefined set of material types, and in which a cell of the matrix contains as a result, for the respective pair? type of article? type of material ?, one or more? of the following certain information: - volume or percentage of volume occupied in the basket; and / or - area or percentage of area occupied in the basket; and / or - number of items to be washed in the basket; and / or - position occupied in the basket defined by a predetermined set of sub-areas of the basket, and in which the matrix? able to provide results only on cells corresponding to combinations? type of article? type of material? predefined as significant. 19. Method according to any one of the preceding claims, wherein? the recognition of the position of each object present in a dishwasher basket is envisaged, and in which said predetermined set of sub-areas of the basket which defines a granularity? of identifiable position includes: - for the upper rack of the dishwasher (21) a first number of sub-areas of the upper rack; and / or - for the lower rack of the dishwasher (22) a second number of sub-areas of the lower rack; and where the position of each object? expressed by indicating the sub-area of the lower or upper basket in which the object is identified. 20. Method according to claim 19, wherein the following are defined: - for the upper basket of the dishwasher (21), three sub-areas of the upper basket (SA1, SA2, SA3), arranged side by side with respect to each other in the direction of a length of the upper basket, each corresponding to about one third the width of the basket; - for the lower basket of the dishwasher (22), three sub-areas of the lower basket (SA4, SA5, SA6), including: a first sub-area of the lower basket (SA6) which extends along the entire length of the lower basket and occupies a first half? the width of the lower basket; a second sub-area of the lower basket (SA4) which occupies a part of the second half? of the width of the lower basket and extends for about two thirds of the length of the lower basket; a third sub-area of the lower basket (SA5) which occupies the remaining part of the second half? the width of the lower basket and extends approximately one third of the length of the lower basket. Method according to claims 18 and 20, in which sub-area matrices are provided as a result, containing the information of the filling level and load condition considered, expressed for each sub-area. Method according to any one of the preceding claims, in which the determining step further comprises determining indications and / or suggestions regarding the arrangement of the objects in the dishwasher, on the basis of the filling and load level information detected on the basis of the processing. of the acquired digital image, and in which the phase of providing information to the user includes: - present in numerical or graphical form the information detected, between said obtainable information on the level of filling of the basket and information on the load condition of the basket; and / or - also provide written warnings to the user containing such indications and / or suggestions regarding the arrangement of the objects in the dishwasher. 23. Method according to claim 22, wherein said indications and / or suggestions provided to the user include: - indication of the optimization of the load between the upper basket and the lower basket of the dishwasher and suggestions for moving objects from one basket to the other; and / or - indication of optimization of the position of objects within a basket and suggestions of moving objects between different sub-areas of a basket. 24. Method according to any one of the preceding claims, in which the steps of acquiring a digital color image and providing information to the user are carried out by means of a portable electronic device (3) equipped with digital image acquisition means and graphic interface, on the basis of an application and / or software program memorized and executable in electronic processing means of the portable electronic device. Method according to any one of the preceding claims, in which the step of determining at least one information of the filling level of the basket and / or of the load condition of the basket is carried out by means of a processing carried out by one or more? remote software programs stored and executed in remote electronic processing means (4), said remote electronic processing means (4) being operatively connected with the electronic processing means of the portable electronic device (30), said one or more? remote software programs being interoperable with the software application and / or program stored and executable in the portable electronic device (3). 26. Method for the preparation and execution of a dishwashing cycle by means of a dishwashing machine (2), in particular domestic, comprising the steps of: - make a dishwasher machine available (2); - place the dishes in the baskets (21, 22) of the dishwasher 82); - carrying out a method for determining filling information of a dishwashing machine according to any one of claims 1-27; - define a recommended washing program, based on the results of the method for determining the filling information of a dishwasher; ? generate a washing preparation notice, which can be consulted by the user, in which said washing preparation notice contains at least one washing instruction, comprising washing parameters of the recommended washing program and in addition one or more? requests for confirmation and / or auxiliary wash preparation advice in addition to said wash instruction; and in which the step of providing information to the user comprises providing the user with said wash preparation notice, in addition to said information about the filling level of the baskets and the loading condition of the baskets. 27. Method according to claim 26, comprising the steps of: ? ask the user for a validation of the generated washing instruction, said validation including an intentional confirmation or modification of the generated washing instruction and an intentional confirmation to start the dishwashing cycle according to the generated or modified washing instruction,? transmit said washing instruction generated or modified to a? unit? electronic control of the dishwashing machine, by means of a transmission of electronic signals and bypassing a user interface of the dishwashing machine (23) for the manual selection of washing parameters, or by means of a manual control via the user interface of the dishwashing machine (23) ; - carry out the washing cycle using the dishwasher (2), controlling the operation of the dishwasher through the unit? electronic control (20) according to the washing instruction generated or modified, transmitted. Method according to claim 25 and any of claims 26 or 27, wherein the transmission of the washing instruction to the electronic control means of the dishwashing machine takes place via a wireless signal connection between the portable electronic device (3) and means of electronic control of the dishwasher (20). 29. System (1) for the preparation and execution of a dishwashing cycle comprising: - a dishwashing machine (2), configured to carry out a dishwashing cycle, and comprising a unit? electronic control of the dishwasher (20), configured to control the execution of a washing program associated with said washing cycle, on the basis of at least one washing instruction received; - a portable electronic device (3), comprising: - digital image acquisition means (31), configured to acquire a digital color image of at least one basket (21, 22) of the dishwashing machine containing items to be washed in a condition of use; - electronic processing means of the portable electronic device (30); - a graphical interface of a portable mobile device (32), configured to provide a user with at least one information about filling the drum and / or a warning of washing preparation containing at least one washing instruction relating to a suggested washing program ; and / or at least a confirmation request and / or auxiliary wash preparation advice in addition to the wash instruction; - remote electronic processing means (4), operatively connected to the portable electronic device (3), and configured for: - receiving (S7) from the portable electronic device (3) digital data corresponding to the acquired digital image; - determine at least one information for filling the drum and / or a recommended washing program and / or advice on auxiliary washing preparation, on the basis of a digital image processing in color, carried out by one or more? remote software programs stored and executed on remote electronic processing means; - transmit (S8) to the portable electronic device (3) at least one information about filling the drum and / or the recommended washing program and / or the auxiliary washing preparation recommendations determined; wherein the electronic processing means of the portable electronic device (3) are configured to perform, by means of an application and / or device software program, the following steps: - preparing a presentation to the user of said at least one drum filling information and / or recommended washing program and / or specific auxiliary washing preparation recommendations; - receive instructions from the user to validate at least one specific washing instruction, corresponding to the recommended washing cycle which? been determined, or a washing instruction modified by the user; wherein said at least one basket filling information comprises: - a filling level, expressed in terms of volume, or percentage of volume, occupied in the basket, and / or one or more? of the following load condition information: - volume, or percentage of volume, occupied in the basket, partitioned by article types belonging to a predefined set of article types; and / or - volume, or percentage of volume, occupied in the drum, partitioned by types of material belonging to a predefined set of types of materials of which the items to be washed are made; and / or - area or percentage of area occupied in the basket; and / or - number of items to be washed in the basket, - and / or number of items to be washed in the basket divided by types of articles belonging to a predefined set of types of articles; and / or - position occupied in the basket by each object present in the basket, according to a granularity? defined by a predetermined set of sub-areas of the basket; and / or - position of the cutlery basket, according to a granularity? defined by a predetermined set of sub-areas of the basket. System (1) according to claim 29, wherein the electronic processing means of the portable electronic device (3) are further configured to transmit (S10) said washing instruction determined, or modified by the user, to the unit? electronic control (20) of the dishwashing machine (2), by means of a transmission of electronic signals and bypassing a user interface of the dishwashing machine (23) for the manual selection of washing parameters, or by means of a manual command via the user interface dishwasher machine (23). System according to claim 29 or claim 30, wherein said portable electronic device (3)? a smartphone or tablet, equipped with a digital camera (31), and in which? memorized said application or software program of portable electronic device (3), executable by the processing means of the smartphone or tablet.