CN116029863A

CN116029863A - Shoe washing method and device, electronic equipment and shoe washing machine

Info

Publication number: CN116029863A
Application number: CN202111248331.3A
Authority: CN
Inventors: 苏明月
Original assignee: Qingdao Haier Technology Co Ltd; Haier Smart Home Co Ltd
Current assignee: Qingdao Haier Technology Co Ltd; Haier Smart Home Co Ltd
Priority date: 2021-10-26
Filing date: 2021-10-26
Publication date: 2023-04-28

Abstract

The invention provides a shoe washing method, a shoe washing device, electronic equipment and a shoe washing machine, wherein the method comprises the following steps: detecting key points of the shoe images to obtain positions of key points of the shoes in the shoe images; determining the size of the shoe based on the position of each shoe key point in the shoe image; a washing pattern of a shoe washing machine is determined based on the size of the shoe, and the shoe is washed based on the washing pattern. According to the method, the device, the electronic equipment and the shoe washing machine, the positions of the key points of the shoes in the shoe images are obtained by detecting the key points of the shoe images, so that the sizes of the shoes can be accurately determined, and the corresponding washing modes are determined according to the sizes of the shoes, so that the shoes with different sizes can be accurately washed, the washing efficiency of the shoe washing machine is greatly improved, the washing energy consumption is reduced, and the washing effect of the shoes is guaranteed.

Description

Shoe washing method and device, electronic equipment and shoe washing machine

Technical Field

The invention relates to the technical field of household appliances, in particular to a shoe washing method and device, electronic equipment and a shoe washing machine.

Background

In recent years, the life and work rhythm of people is faster and faster, and many people do not have time to clean their shoes. The shoe washer is used as a household appliance commonly used in daily life, and brings great convenience to the life of people.

At present, the shoe washing machine realizes the movable cleaning of shoes to be washed through a cleaning device. However, the shoe washer does not automatically distinguish the sizes of shoes, which results in that the cleaning device is always in an idle state in the cleaning process, so that not only the cleaning speed of the shoe washer is affected, but also the shoes are not cleaned cleanly, and the use experience of users is greatly affected.

Disclosure of Invention

The invention provides a shoe washing method, a device, electronic equipment and a shoe washing machine, which are used for solving the defect of poor cleaning efficiency of the shoe washing machine in the prior art and improving the cleaning efficiency of the shoe washing machine.

The invention provides a shoe washing method, which comprises the following steps:

detecting key points of the shoe images to obtain positions of key points of the shoes in the shoe images;

determining the size of the shoe based on the position of each shoe key point in the shoe image;

a washing pattern of a shoe washing machine is determined based on the size of the shoe, and the shoe is washed based on the washing pattern.

According to the method for washing shoes provided by the invention, the determining of the size of the shoes based on the positions of the key points of the shoes in the shoe image comprises the following steps:

determining scale values corresponding to the key points of the shoes based on the positions of the key points of the shoes in the shoe image and the positions of the scale values in the shoe image, wherein the scale values are on a scale built in a shoe washing machine;

and determining the size of the shoe based on the scale value corresponding to each shoe key point.

According to the present invention, there is provided a shoe washing method of determining a washing mode of a shoe washing machine based on the size of the shoe, including:

the washing pattern is determined based on the type and/or material of the shoe, and the size of the shoe.

According to the present invention, there is provided a method for washing shoes, wherein the determining the washing mode based on the type and/or material of the shoes and the size of the shoes includes:

determining the washing parameters of the shoe washing machine based on the type and/or the material of the shoe and the corresponding relation between each type and/or each material and each washing parameter;

determining a brushing range of a shoe washer based on the size of the shoe;

the washing mode is determined based on the washing parameter and the brushing range.

According to the shoe washing method provided by the invention, the type of the shoe is determined based on the following steps:

inputting the shoe image into a type recognition model to obtain the type of the shoe output by the type recognition model;

the type recognition model is trained based on the sample shoe image and the sample type of the sample shoe image.

According to the shoe washing method provided by the invention, the material of the shoe is determined based on the following steps:

inputting the shoe image into a material identification model to obtain the material of the shoe output by the material identification model;

the material recognition model is obtained through training based on sample shoe images and sample materials of the sample shoe images.

According to the shoe washing method provided by the invention, the shoe image is acquired based on the following steps:

if the Hall sensor detects that the shoe washing machine cover is closed, the light source is started, and the image acquisition device is used for acquiring images of shoes placed in the shoe washing machine to obtain the shoe images; wherein, hall sensor, light source and image acquisition device are built-in the shoe-washing machine.

The invention also provides a shoe washing device, comprising:

the detection module is used for detecting key points of the shoe images to obtain positions of key points of the shoes in the shoe images;

a determining module for determining the size of the shoe based on the location of the key points of each shoe in the shoe image;

and the washing module is used for determining a washing mode of the shoe washing machine based on the size of the shoe and washing the shoe based on the washing mode.

The invention also provides an electronic device comprising a hall sensor, a light source, an image acquisition device, a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the steps of the shoe washing method according to any one of the above are realized when the processor executes the program.

The invention also provides a shoe washer, which comprises a shoe washer main body and the electronic equipment, wherein the electronic equipment is arranged on the shoe washer main body.

According to the shoe washing method, the device, the electronic equipment and the shoe washing machine, the positions of the key points of the shoes in the shoe images are obtained by detecting the key points of the shoe images, so that the sizes of the shoes can be accurately determined, and the corresponding washing modes are determined according to the sizes of the shoes, so that the shoes with different sizes can be accurately washed, the washing efficiency of the shoe washing machine is greatly improved, the washing energy consumption is reduced, and the washing effect of the shoes is guaranteed.

Drawings

In order to more clearly illustrate the invention or the technical solutions of the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the invention, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic flow chart of a shoe washing method provided by the invention;

fig. 2 is a flowchart of a method for determining attribute information of shoes according to the present invention;

FIG. 3 is a second schematic flow chart of the shoe washing method according to the present invention;

FIG. 4 is a schematic view of a shoe washing apparatus according to the present invention;

fig. 5 is a schematic structural diagram of an electronic device provided by the present invention;

fig. 6 is a schematic structural view of the shoe washer provided by the present invention.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

At present, the shoe washing machine realizes the movable cleaning of shoes to be washed through a cleaning device. Since the shoes to be washed have different sizes, the brushing range of the washing apparatus is generally required to be set to be larger than the range of the maximum size shoes. However, the shoe washer does not automatically distinguish the sizes of shoes, and the brushing range of the cleaning device cannot be limited, so that the cleaning device is always in an idle state in the cleaning process, the cleaning speed of the shoe washer is affected, the shoes are not cleaned, the energy is wasted, and the use experience of a user is greatly affected.

In this regard, the embodiments of the present invention provide a method for washing shoes. Fig. 1 is a schematic flow chart of a shoe washing method provided by the present invention, as shown in fig. 1, an execution main body of the method is a processor, and the processor may be installed on a shoe washing machine or a cloud server, which is not limited in particular. The method comprises the following steps:

step 110, detecting key points of the shoe image to obtain the positions of key points of each shoe in the shoe image;

step 120, determining the size of the shoe based on the position of each shoe key point in the shoe image;

step 130, determining a washing mode of the shoe washing machine based on the size of the shoe, and washing the shoe based on the washing mode.

In particular, considering that the existing shoe washer does not automatically distinguish the sizes of shoes, the cleaning device is often in an idle state in the cleaning process, so that the cleaning speed of the shoe washer is affected, and the shoes are not cleaned cleanly. Aiming at the problem, the embodiment of the invention firstly carries out key point detection on the shoe image to obtain the position of each shoe key point in the shoe image, then determines the actual size of the shoe according to the position of each shoe key point in the shoe image, then determines the washing mode of the shoe washing machine according to the actual size of the shoe, and finally washes the shoe according to the determined washing mode.

Here, the shoes, that is, the shoes to be cleaned, which are put into the shoe washer by the user, the images of the shoes may be captured by an image capturing device built in the shoe washer and forwarded to the processor, the image capturing device may be a camera, a scanner, a mobile phone or other devices having a photographing function, and the installation position of the image capturing device may be a cover, a sidewall, etc. of the shoe washer, which is not particularly limited in the embodiment of the present invention. The method for detecting the key points specifically may be to detect the outline points of the shoes in the shoe image first, and then determine the key points of the shoes from the outline points, or directly input the shoe image into the key point detection model, so as to obtain the key points of the shoes output by the key point detection model, which is not particularly limited in the embodiment of the invention.

The size of the shoe can comprise information such as the length and the height of the shoe, the size of the shoe can be determined by calculating the length proportion according to the actual length of the reference object and the length of the reference object in the shoe image, calculating the size of the shoe in the shoe image according to the position of each shoe key point in the shoe image, and combining the length proportion and the size of the shoe in the shoe image to obtain the actual size of the shoe, or determining the scale information corresponding to each shoe key point according to the position of each shoe key point in the shoe image, and determining the actual size of the shoe according to the scale information corresponding to each shoe key point. The washing mode, that is, the washing strategy adopted by the shoe washing machine for the current shoe, may be determined only according to the size of the shoe, or may be determined by combining the size of the shoe with other attribute information of the shoe (such as the color, material, shape, etc. of the shoe), which is not particularly limited in the embodiment of the present invention.

It should be noted that, distinguish and wash shoes of different sizes according to the same washing mode in the existing shoe washer, the embodiment of the invention matches the corresponding washing mode according to the size of the shoes to be washed, and washes the shoes to be washed according to the washing mode, thus can guarantee in the running process of the shoe washer, the cleaning device only needs to move in the size range of the shoes to be washed to finish washing the shoes to be washed, and then greatly improve the washing efficiency of the shoe washer, reduce the washing energy consumption, and simultaneously, because the cleaning device acts on the shoes in the washing process, thereby guaranteeing the cleaning effect of the shoes and improving the user experience.

According to the method provided by the embodiment of the invention, the positions of the key points of the shoes in the shoe image are obtained by detecting the key points of the shoe image, so that the size of the shoes can be accurately determined, and then the corresponding washing mode is determined according to the size of the shoes, so that the shoes with different sizes can be accurately washed, the washing efficiency of the shoe washing machine is greatly improved, the washing energy consumption is reduced, and the washing effect of the shoes is ensured.

Based on any of the above embodiments, step 120 includes:

determining the scale value corresponding to each shoe key point based on the position of each shoe key point in the shoe image and the position of each scale value in the shoe image, wherein each scale value is on a scale arranged in the shoe washing machine;

Specifically, a scale with scale values can be preset in the shoe washer, specifically in the position near the shoes, and on the basis, when the image acquisition device acquires the shoe images, the acquired shoe images also comprise the scale values on the scale; then, the image acquisition device can forward the shoe image to the processor, and the processor combines the positions of the key points of the shoes in the shoe image and the positions of the scale values in the shoe image so as to determine the scale values corresponding to the key points of the shoes; finally, the processor may determine the size of the shoe based on the scale values corresponding to the key points of each shoe.

For example, the scale is parallel to the length direction of the shoe, a perpendicular line can be drawn from the first shoe key point and the second shoe key point in the length direction of the shoe to the straight line where the scale is located, the scale value corresponding to the intersection point of the perpendicular line and the scale is the scale value corresponding to the first shoe key point and the second shoe key point, then the scale value corresponding to the first shoe key point and the scale value corresponding to the second shoe key point are subtracted and taken as an absolute value, so that the length of the shoe can be obtained, for example, the scale is not parallel to the length direction of the shoe, the first shoe key point and the second shoe key point in the length direction of the shoe can be rotated to be parallel to the scale, the length of the shoe can be obtained according to the method without rotating the shoe key point, the length ratio between the length direction and the scale direction can be obtained according to the length ratio of the difference between the first shoe key point and the scale value corresponding to the second shoe key point.

Based on any of the above embodiments, in step 130, determining a washing pattern of the shoe washing machine based on the size of the shoe, comprises:

Specifically, considering that the materials and types of different shoes are different, the cleaning modes are also different, the shoes are easy to be washed if the modes are not opposite, the existing shoe washing machine does not automatically distinguish the materials, the types and the like of the shoes, a user is required to judge the shoes by himself or herself, and the user manually selects the washing mode of the shoes, but does not have a knowledge base for washing and protecting the shoes, and does not know what washing mode is suitable for what kind of shoes. In this regard, according to the type of the present shoe and the size of the shoe, or according to the material of the shoe and the size of the shoe, or according to the type, material and size of the shoe, the embodiment of the present invention finally determines a washing mode suitable for the shoe, so that the subsequent shoe washer can use the washing mode to wash the shoe.

Here, the types of shoes include, but are not limited to, sport casual shoes, canvas shoes, leather shoes, boat shoes, middle shoes, boots, high-heeled shoes, sandals, and the like. The materials of the shoes include, but are not limited to, leather materials, fiber materials, cotton and hemp materials, suede materials, net materials, splicing materials, fur materials, etc.

Further, the determination of the washing pattern may also be made in connection with the brand information of the shoes, where the brand information of the shoes may include a parent brand, which refers to the general brand of the shoes, and a child brand, which refers to the brand of a certain series of shoes, which in some cases refers to the brand of the company that produced the shoes.

According to the method provided by the embodiment of the invention, the type and/or the material of the shoes and the size of the shoes are combined to determine the washing mode, so that effective washing can be provided for the shoes, the shoes can be thoroughly cleaned, the shoes can be prevented from being worn in the washing process, and the use experience of users is further improved.

Based on any of the above embodiments, determining a washing pattern based on the type and/or material of the shoe, and the size of the shoe, comprises:

determining a brushing range of the shoe washer based on the size of the shoe;

based on the wash parameters and the brushing range, a wash pattern is determined.

Specifically, the processor may determine the washing pattern of the shoe washing machine by: determining the washing parameters of the shoe washing machine according to the type and/or the material of the current shoe and the corresponding relation between various types and/or materials and various washing parameters; in addition, determining a brushing range of the shoe washer according to the current shoe size; on the basis, the washing mode suitable for the shoe can be determined according to the washing parameters of the shoe washing machine and the washing range of the shoe washing machine, so that the shoe can be washed by the follow-up shoe washing machine in the washing mode.

Here, the washing parameter can be characterized by the parameter that needs to be correspondingly adjusted according to the material and the type of the shoe, for example, the washing parameter can be the washing force, when the material of the shoe is cotton and hemp, the shoe can be washed by adopting the heavier washing force, so that the shoe can be thoroughly cleaned, when the material of the shoe is leather, the shoe can be washed by adopting the lighter washing force, so that the shoe can be thoroughly cleaned, the damage of the shoe in the washing process can be avoided, for example, the washing parameter can also be the washing time, when the type of the shoe is a boat shoe, the shoe can be washed by adopting the shorter washing time, and therefore, the shoe can be cleaned cleanly, the washing energy consumption can be reduced, and when the type of the shoe is a long boot, the shoe can be thoroughly cleaned by adopting the longer washing time. The washing parameter may be one parameter or a plurality of parameters, and the embodiment of the present invention is not particularly limited. Further, the shoe washer is classified according to the cleaning mode, and can be roughly classified into friction cleaning of the shoe brush and water jet cleaning, and the shoe washer in the embodiment of the invention adopts the friction cleaning mode of the shoe brush to clean shoes because the shoe brush can clean the shoes more cleanly, and the brushing range of the shoe washer can represent the size of the moving path range of the shoe brush for automatically brushing the shoes.

It can be understood that different washing parameters and different brushing ranges can be combined into different washing modes, for example, the washing parameters comprise brushing force, the brushing force is divided into a light range, a medium range and a heavy range, the brushing range is divided into a first range, a second range and a third range from small to large, and in the application scene, three different washing parameters and three different brushing ranges can be combined into nine different washing modes.

Further, after the washing mode is determined, the shoe washing machine can also send prompt information in the form of voice, characters, pictures, light and the like to prompt a user to confirm whether the washing mode is suitable, if the user selects to use the washing mode, a washing program corresponding to the washing mode can be started to be called to wash the shoes, and if the user selects to not use the washing mode, a new washing mode can be determined based on the mode of user input or redetermination, so that the use experience of the user is further improved.

Based on any of the above embodiments, the washing parameters include at least one of a washing time, a brushing force, a washing rotational speed, and a washing water amount.

Specifically, the washing parameters of the shoe washer may include one or more of a washing time, a brushing force, a washing rotational speed, and a washing water amount, wherein the washing time may represent a time period during which the shoe is in a washing stage, the brushing force may represent a force of the shoe brush when brushing the shoe, the washing rotational speed may represent a rotational speed of a driving motor in the shoe washer, the washing water amount may represent a water amount required by the shoe washer when washing the shoe, for example, when the shoe is of a boat shoe, a smaller washing water amount may be used to wash the shoe, and when the shoe is of a boot, a larger washing water amount may be used to wash the shoe.

It should be noted that the washing parameters are not limited to the above listed parameters, but may also include washing modes, such as dry cleaning or water washing, rinsing time, and rinsing times, and may be flexibly set and adjusted according to the needs of the user.

Based on any of the above embodiments, the type of shoe is determined based on the following steps:

inputting the shoe image into the type recognition model to obtain the type of the shoe output by the type recognition model;

Specifically, in order to obtain the type of the shoe to be cleaned, the shoe image of the shoe may be input into a type recognition model, and the type recognition model performs type recognition based on the shoe image to obtain the type to which the shoe belongs. Here, the type recognition model may be deployed inside the shoe washer, or may be deployed at the cloud, and invoked by the processor through wireless communication, which is not particularly limited in the embodiment of the present invention.

Before the training, the type recognition model can be obtained in advance, and specifically, the type recognition model can be obtained by training in the following manner: first, a large number of sample shoe images are collected, along with the corresponding sample shoe types. And then training the initial type recognition model based on the sample shoe image and the corresponding type of the sample shoe, so as to obtain a type recognition model. Here, the initial type recognition model may be a single neural network or a combination of a plurality of neural networks, which is not particularly limited in the embodiment of the present invention.

Based on any of the above embodiments, the material of the shoe is determined based on the following steps:

inputting the shoe image into the material identification model to obtain the material of the shoe output by the material identification model;

the material recognition model is trained based on the sample shoe image and the sample material of the sample shoe image.

Specifically, in order to obtain the material of the shoe to be cleaned, the shoe image of the shoe may be input into the material recognition model, and the material recognition model performs material recognition based on the shoe image to obtain the material of the shoe. Here, the material recognition model may be deployed inside the shoe washer, or may be deployed at the cloud, and invoked by the processor through wireless communication, which is not particularly limited in the embodiment of the present invention.

Before the training, a material identification model can be obtained through training in advance, and the material identification model can be obtained through training in the following mode: first, a plurality of sample shoe images are collected, and the materials of the corresponding sample shoes are collected. And then training the initial material identification model based on the sample shoe image and the corresponding material of the sample shoe, thereby obtaining a material identification model. Here, the initial material recognition model may be a single neural network or a combination of a plurality of neural networks, which is not particularly limited in the embodiment of the present invention.

Based on any of the above embodiments, the shoe image is acquired based on the following steps:

if the Hall sensor detects that the shoe washing machine cover is closed, the light source is started, and the image acquisition device is used for acquiring images of the shoes placed in the shoe washing machine to obtain the images of the shoes; wherein, hall sensor, light source and image acquisition device are built-in to wash shoes machine.

Specifically, in order to automatically collect the shoe image, the shoe washing machine in the embodiment of the invention is internally provided with a Hall sensor, a light source and an image collecting device. The user opens the shoe-washing machine lid, puts into shoes and advances the shoe-washing machine, and shoes are fixed on washing shoe anchor clamps, closes the shoe-washing machine lid, on this basis, after hall sensor detects the shoe-washing machine lid and closes, the processor then can control to open the built-in light source of shoe-washing machine to control image acquisition device carries out image acquisition to the shoes of having placed in the shoe-washing machine, thereby can obtain comparatively clear shoes image, and then can improve the accuracy that follow-up washing mode was confirmed, and, need not the user and upload shoes image, further improved user experience.

Further, after the shoe image is obtained, the shoe image may be encoded and format converted, and uploaded to the cloud or sent to a local processor through an http (HyperText Transfer Protocol ) protocol, so that the cloud or the local processor can determine a washing mode of the shoe washer based on the shoe image.

Based on any of the above embodiments, it is considered that the existing shoe washing machine lacks a device for identifying shoe information, so that all shoes can be washed only according to one or more fixed washing modes, and the shoes are easy to be damaged, so that the shoes are not washed cleanly, the washing speed is slow, and unnecessary resource waste is caused.

In this regard, the embodiment of the invention provides a method for automatically identifying shoe attribute information and matching a washing mode, wherein the shoe attribute information comprises the size, the material and the type of a shoe. Fig. 2 is a flow chart of a method for determining attribute information of shoes according to the present invention, as shown in fig. 2, the specific flow of the method is as follows:

firstly, fixing shoes on a shoe washing clamp, and shooting shoe images of all angles by an image acquisition device, wherein the scales are arranged below the shoe washing clamp, and the shoe images also comprise the scales and scale information on scale plates;

immediately, considering that the background interference exists in the shoe image, if the shoe attribute recognition is directly performed based on the shoe image, the recognition effect is poor, and the shoe image can be input into a backbone network for shoe detection to obtain a target image only comprising a shoe area;

then, inputting the target image obtained by the side shoe image into a key point detection model (namely a key point positioning sub-network in fig. 2) to detect key points, so as to obtain the positions of the key points of the shoes in the target image, thereby obtaining the positions of the key points of the shoes in the shoe image; inputting the shoe image into a scale identification model so as to identify and obtain each scale value on a scale dial and the position of each scale value in the shoe image; on the basis, according to the positions of the key points of the shoes in the shoe image and the positions of the scale values in the shoe image, the scale values corresponding to the key points of the shoes are determined, finally, according to the scale values corresponding to the key points of the shoes, the sizes of the shoes are determined, for example, the scales are parallel to the length direction of the shoes, the first scale values and the second scale values corresponding to the key points of the first shoes and the key points of the second shoes in the length direction of the shoes are respectively determined, the first scale values and the second scale values are subtracted and taken as absolute values, the length of the shoes can be obtained, the scales are perpendicular to the height direction of the shoes, the third scale values and the fourth scale values corresponding to the key points of the third shoes and the fourth shoes can be rotated by 90 degrees, and then the third scale values and the fourth scale values are subtracted and taken as absolute values, so that the heights of the shoes can be obtained;

in addition, the target image can be input into a detection subnet network, the detection subnet network can comprise a type identification model and a material identification model, wherein the type identification model frames the position of the shoe by a rectangular frame, carries out shoe type classification based on the rectangular frame, and finally outputs the probability that the shoe belongs to each type, so that the type of the shoe is obtained; the material recognition model frames the position of the shoe by using a rectangular frame, classifies the shoe material based on the rectangular frame, and finally outputs the probability that the shoe belongs to each material, thereby obtaining the material of the shoe.

It should be noted that, in the embodiment of the present invention, each network may be trained separately, or may be combined into an end-to-end network to perform joint training, which is not limited in particular.

Based on any of the above embodiments, fig. 3 is a second schematic flow chart of the shoe washing method provided by the present invention, and as shown in fig. 3, the specific flow chart of the method is as follows:

s1, opening a shoe washing machine cover, putting shoes into a shoe washing machine, and fixing the shoes on a shoe washing clamp;

s2, closing the shoe washing machine cover, detecting that the shoe washing machine cover is closed by the Hall sensor, starting an internal light source, triggering the image acquisition device to be started, and acquiring a shoe image;

s3, coding and format conversion are carried out on the shoe image, and the shoe image is uploaded to a cloud end or sent to a local processor through an http protocol;

s4, the processor performs shoe detection and shoe attribute identification based on the shoe image to obtain information such as shoe type, size, material, brand and the like;

s5, selecting matched washing parameters such as washing time, washing force, washing water quantity and the like according to the type, the material and the brand information of the shoes and the washing knowledge base of the shoes with different types, materials and brands;

s6, determining a brushing range of the shoe washer, namely a range of automatic brushing of the shoe brush, according to the length of the shoe and the height information of the shoe;

and S7, determining a washing mode of the shoe washing machine according to the washing parameters and the washing range, and washing the shoes according to the washing mode.

Based on the above embodiments, considering that the efficiency of on-line transmission is slower, and thus the cleaning efficiency of shoes is affected, the invention shoots and collects the shoe images of the shoes inside the shoe washer by embedding an AI (Artificial Intelligence ) module on the shoe washer cover, automatically identifies the brand, type, material, size, height and other attribute information of the shoes after the user puts the shoes based on big data and image intelligent identification technology, then matches the best cleaning mode according to the identified shoe attribute information, and invokes the corresponding program built in the shoe washer to wash the shoes.

The shoe washing device provided by the invention is described below, and the shoe washing device described below and the shoe washing method described above can be referred to correspondingly.

Based on any of the above embodiments, fig. 4 is a schematic structural diagram of a shoe washing device according to an embodiment of the present invention, as shown in fig. 4, where the device includes:

the detection module 410 is configured to detect key points of the shoe image, so as to obtain positions of key points of each shoe in the shoe image;

a determining module 420 for determining the size of the shoe based on the location of each shoe key in the shoe image;

the washing module 430 is used for determining a washing mode of the shoe washing machine based on the size of the shoe and washing the shoe based on the washing mode.

According to the device provided by the embodiment of the invention, the positions of the key points of the shoes in the shoe image are obtained by detecting the key points of the shoe image, so that the size of the shoes can be accurately determined, and then the corresponding washing mode is determined according to the size of the shoes, so that the shoes with different sizes can be accurately washed, the washing efficiency of the shoe washing machine is greatly improved, the washing energy consumption is reduced, and the washing effect of the shoes is ensured.

Based on any of the above embodiments, the determining module 420 is configured to:

Based on any of the above embodiments, determining a washing pattern of a shoe washing machine based on a size of a shoe, comprising:

determining a brushing range of the shoe washer based on the size of the shoe;

Fig. 5 illustrates a physical schematic diagram of an electronic device, as shown in fig. 5, which may include: processor 510, communication interface (Communications Interface) 520, memory 530, communication bus 540, hall sensor 550, light source 560, and image capture device 570, wherein processor 510, communication interface 520, memory 530 complete communication with each other through communication bus 540. Processor 510 may invoke logic instructions in memory 530 to perform a shoe-washing method comprising: detecting key points of the shoe images to obtain positions of key points of the shoes in the shoe images; determining the size of the shoe based on the location of each shoe key point in the shoe image; a washing pattern of the shoe washing machine is determined based on the size of the shoe, and the shoe is washed based on the washing pattern.

Further, the logic instructions in the memory 530 described above may be implemented in the form of software functional units and may be stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

On the other hand, the invention also provides a shoe washer. Fig. 6 is a schematic structural view of a shoe washer according to the present invention, and as shown in fig. 6, the shoe washer includes a shoe washer body 610, and the electronic device 620 provided as described above, the electronic device 620 being mounted on the shoe washer body 610.

According to the shoe washing machine provided by the embodiment of the invention, the positions of the key points of the shoes in the shoe image are obtained by detecting the key points of the shoe image, so that the size of the shoes can be accurately determined, and then the corresponding washing mode is determined according to the size of the shoes, so that the shoes with different sizes can be accurately washed, the washing efficiency of the shoe washing machine is greatly improved, the washing energy consumption is reduced, and the washing effect of the shoes is ensured.

In another aspect, the present invention also provides a computer program product comprising a computer program storable on a non-transitory computer readable storage medium, the computer program, when executed by a processor, being capable of performing the method of washing shoes provided by the methods described above, the method comprising: detecting key points of the shoe images to obtain positions of key points of the shoes in the shoe images; determining the size of the shoe based on the location of each shoe key point in the shoe image; a washing pattern of the shoe washing machine is determined based on the size of the shoe, and the shoe is washed based on the washing pattern.

In yet another aspect, the present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, is implemented to perform a method of washing shoes provided by the above methods, the method comprising: detecting key points of the shoe images to obtain positions of key points of the shoes in the shoe images; determining the size of the shoe based on the location of each shoe key point in the shoe image; a washing pattern of the shoe washing machine is determined based on the size of the shoe, and the shoe is washed based on the washing pattern.

The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method of washing footwear, comprising:

2. The method of washing shoes according to claim 1, wherein said determining the size of the shoes based on the locations of the respective shoe keypoints in the shoe image comprises:

3. The method of washing shoes according to claim 1, wherein said determining a washing pattern of a shoe washing machine based on the size of the shoes comprises:

4. A method of washing shoes according to claim 3, wherein said determining said washing pattern based on the type and/or material of said shoes, and the size of said shoes, comprises:

determining a brushing range of a shoe washer based on the size of the shoe;

5. A method of washing footwear according to claim 3, wherein the type of footwear is determined based on the steps of:

6. A method of washing footwear according to claim 3, wherein the material of the footwear is determined based on the steps of:

7. The shoe washing method according to any one of claims 1 to 6, characterized in that the shoe image is acquired based on the steps of:

8. A shoe cleaning apparatus, comprising:

9. An electronic device comprising a hall sensor, a light source, an image acquisition device, a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the shoe washing method according to any one of claims 1 to 7 when the program is executed by the processor.

10. A shoe washer comprising a shoe washer body, and the electronic device of claim 9 mounted on the shoe washer body.