WO2020125458A1

WO2020125458A1 - Intelligent dishwasher control method, dishwasher, and apparatus having storage function

Info

Publication number: WO2020125458A1
Application number: PCT/CN2019/123809
Authority: WO
Inventors: 周均扬
Original assignee: 广东美的白色家电技术创新中心有限公司; 美的集团股份有限公司
Priority date: 2018-12-18
Filing date: 2019-12-06
Publication date: 2020-06-25
Also published as: CN109620078A

Abstract

Provided are an intelligent dishwasher control method, a dishwasher, and an apparatus having a storage function. The method comprises: acquiring an image of tableware to be washed in a dishwasher (S11); processing the image so as to recognize information of said tableware (S12); and determining a washing mode matching the information of said tableware, and adjusting the dishwasher to be in the corresponding washing mode (S13). By means of the method, the washing effect of the dishwasher can be improved, and the washing time and washing resources can be saved on.

Description

Dishwasher intelligent control method, dishwasher and device with storage function

This application requires the priority of the Chinese patent application filed on December 18, 2018 with the application number 2018115490143 and the invention titled "Dishwasher Intelligent Control Method, Dishwasher and Device with Storage Function", which is cited by reference All are incorporated into this application.

【Technical field】

The present application relates to the field of smart home technology, in particular to a dishwasher intelligent control method, a dishwasher and a device with a storage function.

【Background technique】

With the improvement of people's living standards, consumers have higher and higher requirements on the kitchen home environment. As a necessary kitchen appliance for modern smart kitchens, dishwashers can release the pressure of household chores, save time, and become more and more popular among consumers. Favored. The cleaning ability of the dishwasher has a direct impact on the health of family members. At present, most dishwashers on the market have a fixed washing time and steps. The cleaning ability is unstable and there is a waste of cleaning resources, and the washing effect is not ideal.

[Invention content]

The technical problem mainly solved by the present application is to provide a dishwasher intelligent control method, a dishwasher and a device with a storage function, which can improve the cleaning effect of the dishwasher.

In order to solve the above technical problems, a technical solution adopted by the present application is to provide an intelligent control method of a dishwasher, including: acquiring an image of dishware to be cleaned in the dishwasher; processing the image to identify the dishware to be cleaned Information; determine the washing mode that matches the information of the dishes to be washed, and adjust the dishwasher to the washing mode.

In order to solve the above technical problems, another technical solution adopted by the present application is to provide a dishwasher including: a processor and an image acquisition device connected to the processor; the image acquisition device is used to acquire tableware to be cleaned in the dishwasher The image; the processor is used to execute the program to implement the method as described above.

In order to solve the above technical problems, another technical solution adopted by the present application is to provide a device with a storage function, which internally stores program instructions, and the program instructions are executed to implement the method described above.

The beneficial effect of the present application is that it is different from the situation in the prior art. In the embodiments of the present application, by acquiring the image of the dishware to be washed in the dishwasher, after processing the image, the information of the dishware to be washed is identified, and finally determined A washing mode that matches the information of the dishes to be washed, and adjusts the dishwasher to the washing mode, so that an appropriate washing mode can be selected according to the identified information of the dishes to be washed. Cleaning effect.

[Description of the drawings]

FIG. 1 is a schematic flowchart of a first embodiment of a dishwasher intelligent control method of the present application;

2 is a schematic diagram of the matching relationship between the information of the tableware to be cleaned and the cleaning mode;

3 is a schematic flowchart of a second embodiment of the intelligent control method of a dishwasher of the present application;

FIG. 4 is a schematic flowchart of step S122 in FIG. 3;

5 is a schematic flowchart of a third embodiment of the intelligent control method of a dishwasher of the present application;

6 is a schematic flowchart of a fourth embodiment of a dishwasher intelligent control method of the present application;

7 is a schematic flow chart of a fifth embodiment of an intelligent control method for a dishwasher of the present application;

FIG. 8 is a schematic diagram of a dishwasher with a rotating arm having multiple water outlets;

9 is a schematic flowchart of a sixth embodiment of the intelligent control method of a dishwasher of the present application;

10 is a schematic flowchart of a seventh embodiment of the intelligent control method of a dishwasher of the present application;

11 is a schematic flowchart of an eighth embodiment of a dishwasher intelligent control method of the present application;

12 is a schematic flowchart of the ninth embodiment of the dishwasher intelligent control method of the present application;

13 is a schematic flowchart of a tenth embodiment of a dishwasher intelligent control method of the present application;

14 is a schematic structural view of an embodiment of a dishwasher of the present application;

15 is a schematic structural diagram of an embodiment of a device with a storage function according to the present application.

【detailed description】

The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without making creative efforts fall within the protection scope of the present application.

As shown in FIG. 1, the first embodiment of the dishwasher intelligent control method of the present application includes:

S11: Acquire images of the dishes to be washed in the dishwasher.

Specifically, an image acquisition device (such as an ordinary black and white camera, a color camera, or a 3D camera, etc.) is installed in the dishwasher. After the user puts the dishes to be washed into the dishwasher or after the dishes have been placed, The image acquisition device can acquire images of the dishes to be washed in the dishwasher. Among them, the dishwasher can obtain multiple images of the dishes to be cleaned, and can also obtain images of the dishes to be cleaned at different angles through multiple cameras.

S12: Process the image to identify the information of the dishes to be washed.

The information of the tableware to be cleaned includes: at least one of the type, number, placement location, material and dirtiness of the tableware to be cleaned. The number of tableware to be cleaned may include the total number of tableware to be cleaned, or may include the number of tableware to be cleaned in each pre-defined area.

The placement position of the tableware to be cleaned is the position information of the tableware to be cleaned in the dishwasher, which may be position coordinates, or identification information of a certain location area, etc.

The materials to be cleaned include glass, ceramics, metal, plastic and other types.

The degree of soiling of the tableware to be cleaned is an important pre-defined indicator to measure the difficulty of cleaning the tableware. It is related to the residual stains on the surface of the tableware. The more residual stains, the higher the degree of dirt, the more difficult the residual stains to clean. The higher the dirtiness. For example, when oil stains adhere to the surface of the cutlery, the degree of dirtiness is higher than that of the vegetable leaves.

Among them, the degree of dirt can be defined as high, medium and low according to the proportion of the dirty area in the tableware surface area. For example, the proportion of the dirty area in the surface area of the tableware is defined as high, and the proportion of the dirty area in the surface area of the tableware is Between 30% and 70% is defined as medium, and the proportion of the dirty area in the tableware surface area is defined as low if it is less than 30%.

In addition, the information of the tableware to be cleaned may also include the type of tableware to be cleaned, such as bowls, dishes, cups, and pots.

Specifically, when recognizing the acquired image of the tableware to be cleaned, the image may be processed by using an image recognition algorithm or a pre-trained image recognition model, so as to recognize at least one of the above information of the tableware to be cleaned in the image.

S13: Determine a washing mode matching the information of the dishes to be washed, and adjust the dishwasher to the washing mode.

Among them, the cleaning mode includes cleaning parameters for washing the tableware to be cleaned, and the cleaning parameters include cleaning time, water outlet position, water outlet direction, flushing strength, water temperature, detergent dosage or number of nozzles, etc.

For different tableware information to be cleaned, the matching cleaning mode may be different. For example, the washing temperature of plastic cannot exceed 80 degrees Celsius, and the temperature must be adjusted for plastic tableware. That is, when the material of the tableware to be washed includes plastic, the temperature of the water in the matching cleaning mode cannot exceed 80 degrees Celsius; while oil stains need high temperature, strong For washing, if the surface of the tableware to be cleaned has oil stains, the recognized degree of dirtiness of the tableware to be cleaned is higher. At this time, the water temperature in the matched cleaning mode is higher and the flushing power is greater. Therefore, the information of the tableware to be washed obtained through image recognition can adjust the washing parameters of the dishwasher to obtain a matching washing mode, thereby achieving intelligent washing.

Specifically, the dishwasher stores the information of the matching relationship between the information of the dishes to be cleaned and the washing mode, such as the matching relationship table shown in FIG. 2. After identifying the information of the dishes to be cleaned in the dishwasher through the image, you can pass The information of the tableware to be cleaned finds a matching cleaning mode. For example, when the obtained information of the tableware to be cleaned is a combination of 8 ceramics, placed on the upper layer, and the degree of dirt is medium, the matching cleaning mode is B can be found through the table in FIG. 2. Then, adjust the dishwasher to the washing mode, that is, the dishes to be washed in the dishwasher can be specifically cleaned, thereby helping to improve the washing effect of the dishwasher.

When identifying the material of the tableware to be cleaned in this application, it can be judged according to the external parameters (such as color, shape, etc.) of the tableware.

Specifically, as shown in FIG. 3, the second embodiment of the intelligent control method of the dishwasher of the present application is based on the first embodiment of the intelligent control method of the dishwasher of the present application, and further defining step S12 includes:

S121: Process the acquired image of the tableware to be cleaned to obtain external parameters of the tableware to be cleaned.

Wherein, the external parameters include at least the color and shape of the tableware to be cleaned. The external parameters may also include other parameters such as the texture of the dishes to be cleaned.

Specifically, when processing the acquired image of the tableware to be cleaned, the area of the tableware to be cleaned can be identified according to the difference between the tableware to be cleaned and the background, and then the tableware to be cleaned can be determined according to the pixel value and the boundary contour of the tableware area to be cleaned Colors and shapes. Of course, the recognition process can also be directly processed with the trained image recognition model, and finally the required external parameters are output.

S122: Match the external parameters of the tableware to be cleaned to determine the material of the tableware to be cleaned.

Specifically, for most types of tableware, the material can be directly distinguished according to the color and shape of the tableware, for example, the color of glass tableware is usually transparent or translucent, the color of stainless steel tableware is usually silver, etc.; and the shape of the tableware can give the tableware material The judgment provides a priori information. For example, stainless steel is usually used in tableware such as bowls, basins, chopsticks, etc., and stainless steel is rarely used for cups. At the same time, the type of tableware can be recognized from the shape of the tableware, so if a tableware recognizes its If the shape is the shape of a bowl and the color is silver, it can be judged that the material is stainless steel. Therefore, the external parameters of the tableware to be cleaned, such as color and shape, can be used to determine the matching material of the tableware to be cleaned. Of course, you can also combine multiple external parameters (such as color, shape and texture combination) to determine the material of the tableware.

Optionally, sometimes the material of certain tableware cannot be accurately determined only based on the external parameters of the tableware, in this case, ultrasonic technology can be used for identification. Specifically, as shown in FIG. 4, step S122 includes:

S1221: Obtain the color and shape of the tableware to be cleaned from external parameters, and find the material that matches the color and shape of the tableware to be cleaned.

Specifically, tableware material correspondence data (such as tableware material correspondence table) may be pre-stored in the dishwasher. The tableware material correspondence table stores the correspondence between the color and shape of the tableware and the material of the tableware, one of which is the color and shape The combination of may correspond to multiple materials. After obtaining the color and shape of the tableware to be cleaned from the external parameters, the material corresponding to the color and shape of the tableware to be cleaned can be found by searching the table corresponding to the tableware material.

S1222: Determine whether there are more than one material found that matches the color and shape of the tableware to be cleaned.

Specifically, a combination of a certain color and a certain shape may correspond to a variety of materials, for example, the combination of white and bowl-shaped materials corresponds to ceramics and plastics. At this time, the white bowl-shaped tableware found using the tableware material correspondence table matches There are two kinds of materials, ceramic and plastic, and more than one, then perform the following step S1224, otherwise perform step S1223, and use the found material as the material of the tableware to be cleaned.

S1223: Use the found material as the material of the tableware to be cleaned.

S1224: Transmit ultrasonic waves to the dishes to be cleaned.

Wherein, an ultrasonic device may be installed in the dishwasher, which may transmit ultrasonic waves to the corresponding tableware to be cleaned, for example, to a white bowl at a certain position.

S1225: Receive the echo signal reflected by the tableware to be cleaned.

Among them, when the ultrasonic wave emitted by the ultrasonic device contacts the tableware to be cleaned, part of it is absorbed by the tableware to be cleaned and part of it will be reflected back. The ultrasonic device can also receive the echo signal reflected back from the tableware to be cleaned.

S1226: Find the material matching the echo signal to determine the material of the tableware to be cleaned.

Specifically, due to the different degree of absorption of ultrasonic waves by dishes of different materials, the echo signals reflected by them will also be different. Therefore, by analyzing the echo signals reflected by the dishes to be cleaned, it can be found that the echo signals are related to the echo signals. Matching materials. Among them, the dishwasher can pre-store echo signal templates corresponding to different materials, and compare the received echo signal with the echo signal template. The material corresponding to the echo signal template with the smallest gap or the highest similarity is In order to match the material of the echo signal, the ultrasonic technology can be used to accurately identify the material of the tableware to be cleaned, so as to match the appropriate cleaning mode, which helps to obtain a better cleaning effect.

When recognizing the information of the tableware to be cleaned in this application, deep learning and neural network technology can be used to establish a recognition model to improve the recognition accuracy.

Specifically, as shown in FIG. 5, the third embodiment of the intelligent control method of the dishwasher of the present application is based on the first embodiment of the intelligent control method of the dishwasher of the present application, and further defining step S12 includes:

S123: Input the image of the tableware to be cleaned into the tableware information recognition model to identify the information of the tableware to be cleaned.

In this embodiment, the execution process of steps S11 and S13 may refer to the first embodiment of the dishwasher intelligent control method of the present application, and will not be repeated here.

In step S123, the tableware information recognition model is an image recognition model based on a deep convolutional neural network stored in the dishwasher. Of course, in other embodiments, the tableware information recognition model may also be stored on the server, and the dishwasher connects to the server through the network to obtain parameter information of the tableware information recognition model.

Specifically, the tableware information recognition model is an image recognition model stored in the dishwasher in advance, and the tableware information recognition model is a pre-trained image recognition model based on a deep convolutional neural network. The image of the tableware to be cleaned is directly input into the tableware information recognition model, and the tableware information recognition model can automatically recognize and output the information of the tableware to be cleaned in the image, such as outputting the number, type, material, placement position of the tableware to be cleaned, etc. information.

Wherein, the tableware information recognition model can also learn according to the image of the tableware recognized each time, and update its model parameters to improve the recognition accuracy of the model. For each family, the tableware is relatively fixed, and the dishwasher can also estimate the information of the tableware that cannot be fully recognized in the image based on the historical identification data to output the complete information of the tableware to be washed, or use the historical data to help determine the material of the tableware, Quantity etc.

In other embodiments, the user may input the information of the tableware to be cleaned into the dishwasher at the same time or after the tableware to be cleaned is put into the dishwasher, so that the dishwasher can supplement or update the identified tableware to be cleaned Tableware information.

Specifically, as shown in FIG. 6, the fourth embodiment of the intelligent control method of the dishwasher of the present application is based on the first embodiment of the intelligent control method of the dishwasher of the present application, and after further defining step S12, includes:

S21: Acquire the first information of the tableware to be cleaned input by the user.

Wherein, the first information may include at least one of information such as type, quantity, placement position, material and the like of the tableware to be cleaned input by the user.

Specifically, the dishwasher can obtain the user input to be cleaned by voice interaction or receiving a user input device (such as a keyboard provided on the dishwasher), or by receiving information sent by a terminal device connected to the dishwasher The first information of tableware. After identifying the information of the dishes to be cleaned, the dishwasher may send a voice message to the user to confirm whether the information of the recognized dishes to be cleaned is accurate, or may prompt the user to input the first information by voice, or When the identified information of the tableware to be cleaned is incomplete, for example, when the information of the tableware to be cleaned at a certain position cannot be identified, a prompt is sent to the user to prompt the user to input the first information.

S22: Use the first information to update the information of the tableware to be cleaned.

Specifically, when the first information is inconsistent with the identified information of the tableware to be cleaned, the dishwasher may use the first information to update the information of the tableware to be cleaned, so that the information of the tableware to be cleaned is more complete and accurate, In order to choose the appropriate cleaning mode later, it will help to further improve the cleaning effect.

As shown in FIG. 7, the fifth embodiment of the intelligent control method of the dishwasher of the present application is based on the first embodiment of the intelligent control method of the dishwasher of the present application, and further defining step S13 includes:

S131: Adjust the water outlet position and/or water outlet direction of the dishwasher according to the placement position of the tableware to be cleaned, or select some nozzles to spray water to perform directional cleaning of the tableware to be cleaned.

Specifically, in an application example, as shown in FIG. 8, the dishwasher 10 is provided with a bowl basket for placing tableware, and the bowl basket is divided into tableware placement areas (such as areas A and B in FIG. 8) The water outlet device C is provided at the bottom of the bowl and basket, wherein the water outlet device C may be a swing arm having multiple water outlet holes as shown in FIG. 8, which may be rotated or fixed. When processing the image of the tableware to be cleaned, the position of the tableware to be cleaned in the image can be identified, and then the coordinate conversion is used to convert the position of the tableware to be cleaned in the image into the relative position of the tableware to be cleaned in the dishwasher , That is, the placement position of the tableware to be cleaned. After that, according to the placement position of the dishware to be cleaned, the water outlet direction or the water outlet position of the water outlet device of the dishwasher may be adjusted, or the water outlet direction and the water outlet position may be adjusted at the same time to perform directional cleaning of the tableware to be washed. For example, in FIG. 8, the place to put the dishes to be cleaned is area A, and no dishes are placed in area B. At this time, the water outlet C can be adjusted toward the water outlet of area A, and the water toward the water outlet of area B does not emit water. According to the specific position coordinates of the tableware to be cleaned (as shown in FIG. 8 on the left side of area A), adjust the water outlet direction of the water outlet device C, or adjust the water outlet device C to rotate within a certain angle range, so that directional cleaning can also save Use water.

In another application example, a plurality of nozzles can be provided inside the dishwasher, each nozzle can be independently controlled, or some nozzles can be controlled not to emit water, and some nozzles can emit water. When the placement position of the tableware to be cleaned is identified, it can be directly Select the nozzle facing the placement position to spray water, and the other nozzles do not spray water, so as to achieve directional cleaning, improve the cleaning effect and save water.

In this embodiment, the execution process of steps S11 and S12 may refer to the first embodiment of the dishwasher intelligent control method of the present application, and will not be repeated here.

As shown in FIG. 9, the sixth embodiment of the intelligent control method of the dishwasher of the present application is based on the first embodiment of the intelligent control method of the dishwasher of the present application, and further defining step S13 includes:

S132: According to the number of tableware to be cleaned, select the cleaning time and/or the number of spray nozzles matching the number of tableware to be cleaned.

Among them, the more the number of tableware to be cleaned, the longer the matched cleaning time, the more the number of spray nozzles, and the smaller the number of tableware to be cleaned, the shorter the matched cleaning time, the smaller the number of spray nozzles .

Specifically, after acquiring the image of the tableware to be cleaned, the image is processed, for example, the image is input into a pre-trained tableware recognition model to obtain the information of the tableware to be cleaned output by the tableware recognition model. When the information includes the number of dishes to be cleaned, the washing time or the number of spray nozzles matching the number or a combination of the two can be selected according to the number of dishes to be cleaned. Correspondence data of the number of dishes to be washed and the washing time and/or the number of spray nozzles can be pre-stored in the dishwasher, so that after identifying the number of dishes to be washed, the data can be directly searched from the stored data, that is, A matching cleaning time and/or number of spray nozzles can be obtained.

As shown in FIG. 10, the seventh embodiment of the intelligent control method of the dishwasher of the present application is based on the first embodiment of the intelligent control method of the dishwasher of the present application, and further defining step S13 includes:

S133: According to the material of the tableware to be cleaned, select the water temperature and/or the amount of detergent matching the material to quickly clean the tableware to be cleaned.

Specifically, for different materials, the difficulty of cleaning may be different. For example, stains on stainless steel are usually more difficult to clean than stains on ceramics. In this case, you can make the stains faster by increasing the water temperature or increasing the amount of detergent, or adjusting both at the same time. It is washed away, which can improve the cleaning effect and accelerate the cleaning speed. Correspondence data between the materials of the dishes to be washed and the water temperature and/or the amount of detergent can be pre-stored in the dishwasher, so that after the materials of the dishes to be washed are identified and directly searched from the stored data, a match can be obtained Water temperature and/or detergent dosage.

As shown in FIG. 11, the eighth embodiment of the intelligent control method of the dishwasher of the present application is based on the first embodiment of the intelligent control method of the dishwasher of the present application, and further defining step S13 includes:

S134: According to the degree of dirt of the tableware to be cleaned, select the flushing strength, cleaning time, water temperature, type of detergent and amount of detergent that match the degree of dirt.

Among them, the degree of soiling of the tableware to be cleaned is a predefined value, which is related to the type of stain remaining on the surface of the tableware to be cleaned, the area of stains, the number of stains, and the state of stains. For example, the range of pre-defined dirt levels is 0-10, the number 0 indicates the lowest degree of dirt and is easier to clean, and the number 10 indicates the highest degree of dirt and the most difficult to clean. When the stains on the surface of the tableware to be cleaned are more, the area is larger, the stain type is oil, and the stain status is solidified, the higher the degree of dirt. For example, when the stain remaining on the surface of the tableware to be cleaned is a solidified oily substance, the degree of dirt is higher than the stain remaining on the surface is vegetable leaves.

Specifically, after the image of the tableware to be cleaned is acquired, the image may be processed to identify at least one piece of information on the type, area, quantity, and status of the stain remaining on the surface of the tableware to be cleaned, and then find the corresponding degree of dirt based on the information. Among them, when recognizing the degree of contamination of a plurality of tableware to be cleaned, one can identify a degree of soiling for each tableware to be cleaned, and then take the average value or do other calculations (such as taking the maximum value) to finally obtain the tableware to be cleaned The degree of dirt. After that, corresponding cleaning parameters can be selected according to the degree of dirt, including at least one of flushing strength, cleaning time, water temperature, detergent type, and detergent dosage. For example, when it is recognized that the degree of soiling of the dishes to be cleaned is 8, you can choose a larger flushing strength, a longer cleaning time, a higher water temperature, and a more effective type of detergent (such as the degree of soiling of hot pot oil) High, you can choose a detergent that dissolves oil more easily), at least one of the more detergents, which can speed up the cleaning speed and improve the cleaning effect.

In other embodiments, after the user places the tableware to be cleaned, a cleaning instruction may be directly given. At this time, a cleaning mode that matches the information of the identified tableware to be cleaned and the cleaning instruction may be comprehensively considered. More suitable cleaning mode.

Specifically, as shown in FIG. 12, the ninth embodiment of the intelligent control method of the dishwasher of the present application is based on the first embodiment of the intelligent control method of the dishwasher of the present application, and further defining step S13 includes:

S135: Determine a first cleaning mode that matches the identified information of the tableware to be cleaned.

The execution process of step S135 may refer to the execution process of step S13 in the first embodiment of the dishwasher intelligent control method of the present application, and will not be repeated here.

S136: Obtain the washing instruction of the dishwasher input by the user.

Wherein, the cleaning instruction includes a second cleaning mode or cleaning time.

Specifically, the dishwasher can obtain the cleaning instruction input by the user through voice interaction or receiving a user input device (such as a keyboard provided on the dishwasher), or receiving information sent by a terminal device connected to the dishwasher .

S137: Adjust the parameters of the first cleaning mode using the second cleaning mode or the cleaning time, and adjust the dishwasher to the first cleaning mode after adjusting the parameters.

Specifically, after acquiring the cleaning instruction input by the user, if the cleaning instruction includes the second cleaning mode, the dishwasher may compare the second cleaning mode with the first cleaning mode, and when the two are different, it may use the The parameters of the second cleaning mode adjust the parameters of the first cleaning mode. For example, the parameters of the two can be averaged or weighted average to calculate the adjusted first cleaning mode. Preferably, the parameters are adjusted by using a weighted average. When calculating, the weight of setting the parameters of the first cleaning mode is greater than the weight of the parameters of the second cleaning mode, so as to comprehensively consider user needs while reducing the user’s lack of understanding of the operation of the dishwasher And the impact of giving inappropriate cleaning instructions. When the cleaning instruction includes the cleaning time, the parameter adjustment process can refer to the above process, and will not be repeated here.

In other embodiments, the dishwasher may also obtain the degree of soiling of the dishes during the cleaning process in real time in order to adjust the cleaning mode and speed up the cleaning process.

Specifically, as shown in FIG. 13, the tenth embodiment of the intelligent control method for dishwashers of the present application is based on the first embodiment of the intelligent control method of dishwashers of the present application, and after further defining step S13, further includes:

S14: Acquire the washing process image of the dishes to be washed.

Specifically, the dishwasher may use the camera installed inside to obtain the cleaning process image of the dishes to be cleaned in real time or periodically, or directly shoot the video of the cleaning process to obtain the cleaning process image.

S15: Process the image of the cleaning process to identify changes in the degree of dirt of the tableware to be cleaned.

Specifically, for the image processing of the cleaning process, an image recognition algorithm or a trained image recognition model may be used for recognition processing to obtain the change in the degree of soiling of the tableware to be cleaned, that is, the degree of soiling and cleaning of the tableware to be cleaned Time relationship data, such as the relationship table or curve of the two.

S16: It is judged whether the change of the degree of dirt is in line with the expected cleaning effect.

Among them, the expected cleaning effect is a table of the expected degree of contamination corresponding to the preset cleaning time, or the relationship curve between the preset cleaning time and the expected degree of contamination, or directly the expected dirty corresponding to one or several cleaning times The range data of the degree of contamination change, or directly the expected rate of change of the degree of contamination, etc. Different cleaning modes can correspond to different expected cleaning effects.

Specifically, in an application example, the expected cleaning effect is a relationship curve between a preset cleaning time and an expected degree of contamination. When it is recognized that the degree of soiling of the tableware to be cleaned changes, that is, the relationship between the actual degree of soiling of the tableware to be cleaned and the cleaning time is obtained, it can be compared with the expected cleaning effect. For example, comparing the actual degree of contamination corresponding to the current cleaning time with the expected degree of contamination, if the actual degree of contamination is higher than the expected degree of contamination, or the actual degree of contamination of both is higher than the expected degree of contamination, and When the difference between the two exceeds the allowable range, it is determined that the change in the degree of contamination does not meet the expected cleaning effect, otherwise it is determined that the change in the degree of contamination meets the expected cleaning effect. Alternatively, you can directly obtain the ratio of the actual degree of dirt to the cleaning time (the actual rate of change of the degree of dirt) and the ratio of the expected degree of dirt to the cleaning time (the expected rate of change of the degree of dirt) for comparison. When the expected change rate is slow, or the actual change rate is less than the expected change rate, and the difference between the two exceeds the allowable range, it is determined that the change in the degree of contamination does not meet the expected cleaning effect.

In the case where the degree of contamination does not meet the expected cleaning effect, in response to the change in the degree of contamination not meeting the expected cleaning effect, step S17 is executed.

S17: Choose at least one of measures to increase the intensity of flushing, increase the cleaning time, increase the water temperature, and increase the amount of detergent to speed up the cleaning of dirt.

In the case where the degree of dirt meets the expected cleaning effect, in response to the change in degree of dirt meeting the expected cleaning effect, step S18 is executed.

S18: The current cleaning mode is still used for cleaning.

Specifically, the change in the degree of dirt does not meet the expected cleaning effect, that is, the cleaning effect of the cleaning mode does not meet the expectations, and the cleaning speed of the stain is too slow. In this case, you can choose to increase the flushing power, increase the cleaning time, and increase the water temperature. 1. Increase the amount of detergent at least one measure to speed up the cleaning of dirt. If the degree of dirt is in line with the expected cleaning effect, the current cleaning mode can still be used for cleaning. Therefore, the dishwasher can periodically monitor the change in the degree of contamination of the cleaning process, so that when the change in the degree of contamination does not meet the expectations, the cleaning parameters can be adjusted in time to accelerate the cleaning speed and improve the cleaning effect.

The above embodiments of the dishwasher intelligent control method of the present application can be combined with each other.

As shown in FIG. 14, in an embodiment of the dishwasher of the present application, the dishwasher 100 includes a processor 110 and an image acquisition device 120 connected to the processor 110.

The image acquisition device 120 may be an ordinary camera or a three-dimensional camera, and is used to acquire images of the dishes to be washed in the dishwasher 100. The number of the image acquiring devices 120 may also be multiple, and the shooting is performed at different angles to acquire a complete image of the dishes to be washed, so that the processor 110 can recognize them.

The processor 110 may also be called a CPU (Central Processing Unit). The processor 110 may be an integrated circuit chip with signal processing capabilities. The processor 110 may also be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, and discrete hardware components . The general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The processor 110 is used to execute a program to implement the method as provided in any one of the first to tenth embodiments of the dishwasher intelligent control method of the present application or a non-conflicting combination thereof.

Optionally, the dishwasher 100 further includes: a memory 130, connected to the processor 110, for storing programs and data required by the processor 110 during execution.

Optionally, the dishwasher 100 further includes an ultrasonic device 140, connected to the processor 110, for transmitting ultrasonic waves to the dishes to be cleaned and receiving echo signals reflected by the dishes to be cleaned, so as to identify the material of the dishes to be cleaned.

Optionally, the dishwasher 100 further includes: a human-machine interaction device 150, connected to the processor 110, for receiving information or instructions input by the user.

The human-computer interaction device 150 may be a voice interaction device, an input/output device such as a touch screen, or a circuit that communicates with a user terminal device connected to the dishwasher 100 such as an antenna circuit.

As shown in FIG. 15, in an embodiment of a device with a storage function in the present application, a device instruction with a storage function 200 internally stores program instructions 210 executable by the processor, and the program instructions 210 are executed to implement a dishwasher as in the present application. Intelligent control method The method provided in any one of the first to tenth embodiments or a non-conflicting combination thereof.

The device 200 with a storage function may specifically be a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, etc. that can store program instructions The medium may also be a server that stores the program instructions. The server may send the stored program instructions to other devices to run, or it may run the stored program instructions by itself.

In an embodiment, the device 200 with a storage function may also be a memory as shown in FIG. 14.

In the several embodiments provided in this application, it should be understood that the disclosed method and device may be implemented in other ways. For example, the device implementation described above is only schematic. For example, the division of modules or units is only a division of logical functions. In actual implementation, there may be other divisions, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical, or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or software function unit.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application may be essentially or part of the contribution to the existing technology or all or part of the technical solution may be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the methods of the embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code .

The above are only the embodiments of the present application, and do not limit the patent scope of the present application. Any changes to the equivalent structure or equivalent process made by the description and drawings of this application, or used directly or indirectly in other related technologies In the field, the same reason is included in the scope of patent protection of this application.

Claims

An intelligent control method of a dishwasher, characterized in that it includes:

Get images of the dishes to be washed in the dishwasher;

Processing the image to identify the information of the tableware to be cleaned;

Determine a washing mode that matches the information of the dishes to be washed, and adjust the dishwasher to the washing mode.
The method according to claim 1, wherein the information of the tableware to be cleaned comprises: at least one of the type, number, placement position, material and dirtiness of the tableware to be cleaned.
The method according to claim 2, wherein the information for processing the image to identify the tableware to be cleaned includes:

Processing the image to obtain external parameters of the tableware to be cleaned, wherein the external parameters include at least the color and shape of the tableware to be cleaned;

The external parameters of the tableware to be cleaned are matched to determine the material of the tableware to be cleaned.
The method according to claim 3, wherein the matching of the external parameters of the tableware to be washed to determine the material of the tableware to be washed includes:

Obtaining the color and shape of the tableware to be cleaned from the external parameters, and searching for a material that matches the color and shape of the tableware to be cleaned;

Judging whether there are more than one found material matching the color and shape of the tableware to be cleaned;

In response to more than one material matching the color and shape of the tableware to be cleaned, transmitting ultrasonic waves to the tableware to be cleaned;

Receiving echo signals reflected by the tableware to be cleaned;

Find a material that matches the echo signal to determine the material of the tableware to be cleaned.
The method according to claim 1, wherein the information for processing the image to identify the tableware to be cleaned includes:

Input the image into the tableware information recognition model to identify the information of the tableware to be cleaned;

Wherein, the tableware information recognition model is an image recognition model based on deep convolutional neural network.
The method according to claim 1, wherein after processing the image to identify the information of the tableware to be cleaned, the method includes:

Obtain the first information of the tableware to be cleaned input by the user;

Use the first information to update the information of the tableware to be cleaned.
The method according to claim 2, wherein the determining a washing mode that matches the information of the tableware to be washed, and adjusting the dishwasher to the washing mode includes:

According to the placement position of the tableware to be cleaned, adjust the water outlet position and/or water outlet direction of the dishwasher, or select a part of nozzles to spray water to perform directional cleaning of the tableware to be washed.
The method according to claim 2, wherein the determining a washing mode that matches the information of the tableware to be washed, and adjusting the dishwasher to the washing mode includes:

According to the number of tableware to be cleaned, a cleaning time and/or a number of spray nozzles matching the number of tableware to be cleaned are selected.
The method according to claim 2, wherein the determining a washing mode that matches the information of the tableware to be washed, and adjusting the dishwasher to the washing mode includes:

According to the material of the tableware to be cleaned, the water temperature and/or the amount of detergent matching the material is selected to quickly clean the tableware to be cleaned.
The method according to claim 2, wherein the determining a washing mode that matches the information of the tableware to be washed, and adjusting the dishwasher to the washing mode includes:

According to the degree of soiling of the tableware to be cleaned, the flushing strength, cleaning time, water temperature, type of detergent and amount of detergent matching the degree of soiling are selected.
The method according to claim 2, wherein the determining a washing mode that matches the information of the tableware to be washed, and adjusting the dishwasher to the washing mode includes:

The first cleaning mode determined to match the information of the tableware to be cleaned;

Obtaining a washing instruction of the dishwasher input by a user, the washing instruction including a second washing mode or a washing time;

Use the second cleaning mode or the cleaning time to adjust the parameters of the first cleaning mode, and adjust the dishwasher to the first cleaning mode after adjusting the parameters.
The method according to claim 2, wherein after determining the washing mode that matches the information of the tableware to be washed and adjusting the dishwasher to the washing mode, the method further includes:

Acquiring images of the cleaning process of the tableware to be cleaned;

Processing the image of the cleaning process to identify changes in the degree of contamination of the tableware to be cleaned;

Judging whether the change in the degree of dirt meets the expected cleaning effect;

In response to that the change in the degree of dirt does not meet the expected cleaning effect, at least one of the measures of increasing the flushing power, increasing the cleaning time, increasing the water temperature, and increasing the amount of detergent is selected to accelerate the cleaning speed of the stain.
A dishwasher, characterized by comprising: a processor and an image acquisition device connected to the processor;

The image acquisition device is used to acquire images of the dishes to be washed in the dishwasher;

The processor is used to execute a program to implement the method according to any one of claims 1-12.
The dishwasher according to claim 13, further comprising: a memory, connected to the processor, for storing programs and data required by the processor during execution.
The dishwasher according to claim 13, further comprising: an ultrasonic device, connected to the processor, for transmitting ultrasonic waves to the dishes to be washed and receiving echo signals reflected by the dishes to be washed To identify the material of the tableware to be cleaned.
The dishwasher according to claim 13, further comprising: a human-machine interaction device, connected to the processor, for receiving information or instructions input by a user.
A device with a storage function, which stores program instructions internally, characterized in that the program instructions are executed to implement the method according to any one of claims 1-12.