CN107447442B - Alarm method based on image recognition technology and intelligent device - Google Patents

Alarm method based on image recognition technology and intelligent device Download PDF

Info

Publication number
CN107447442B
CN107447442B CN201710776522.4A CN201710776522A CN107447442B CN 107447442 B CN107447442 B CN 107447442B CN 201710776522 A CN201710776522 A CN 201710776522A CN 107447442 B CN107447442 B CN 107447442B
Authority
CN
China
Prior art keywords
washing machine
intelligent
clothes
preset
foreign matter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710776522.4A
Other languages
Chinese (zh)
Other versions
CN107447442A (en
Inventor
杜光东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Shenglu IoT Communication Technology Co Ltd
Original Assignee
Shenzhen Shenglu IoT Communication Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Shenglu IoT Communication Technology Co Ltd filed Critical Shenzhen Shenglu IoT Communication Technology Co Ltd
Priority to CN201710776522.4A priority Critical patent/CN107447442B/en
Publication of CN107447442A publication Critical patent/CN107447442A/en
Application granted granted Critical
Publication of CN107447442B publication Critical patent/CN107447442B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • DTEXTILES; PAPER
    • D06TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
    • D06FLAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
    • D06F37/00Details specific to washing machines covered by groups D06F21/00 - D06F25/00
    • D06F37/42Safety arrangements, e.g. for stopping rotation of the receptacle upon opening of the casing door
    • DTEXTILES; PAPER
    • D06TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
    • D06FLAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
    • D06F33/00Control of operations performed in washing machines or washer-dryers 
    • D06F2202/02
    • D06F2202/12
    • D06F2204/10

Abstract

The invention discloses a foreign matter alarm method based on an image recognition technology and an intelligent washing machine, wherein the method comprises the following steps: before the intelligent washing machine washes preset clothes, obtaining a picture of the internal space of the washing machine in the intelligent washing machine, wherein the picture is shot by the intelligent camera; judging whether the intelligent washing machine comprises foreign matter materials or not based on the picture of the internal space of the washing machine; and if the intelligent washing machine comprises foreign matter materials, sending an alarm message to the intelligent terminal, wherein the foreign matter alarm message is used for reminding a user that foreign matters exist in the intelligent washing machine. By adopting the embodiment of the invention, whether foreign matters exist in the clothes is judged by analyzing the pictures of the internal space of the washing machine collected by the intelligent camera, and an alarm is given in time, so that the clothes washing effect is improved.

Description

Alarm method based on image recognition technology and intelligent device
Technical Field
The invention relates to the technical field of Internet of things, in particular to a foreign matter alarm method based on an image recognition technology and an intelligent washing machine.
Background
As a common household appliance, the washing machine brings great convenience to the life of people, and when the clothes of people are dirty, the clothes can be automatically cleaned only by putting the clothes into the washing machine and adjusting the mode.
However, when people put clothes in the washing machine, if people forget to take out objects such as a mobile phone, a key and the like in a pocket, and then wash the objects together with the clothes, the electric appliance can be damaged, and meanwhile, the washing machine can be damaged by hard substances such as the key and the like; or, if the paper towel is arranged in the pocket, a great amount of paper scraps can be stuck on the clothes, and the trouble is caused.
Disclosure of Invention
The embodiment of the invention provides a foreign matter alarm method based on an image recognition technology and an intelligent washing machine, which are used for detecting foreign matters existing in clothes in the washing machine and improving the washing effect.
In a first aspect, an embodiment of the present invention provides a foreign object alarm method based on an image recognition technology, where the method is applied to a foreign object alarm system based on an image recognition technology, where the foreign object alarm system based on an image recognition technology includes an intelligent washing machine, an intelligent camera disposed in the intelligent washing machine, and an intelligent terminal, and the method includes:
before the intelligent washing machine washes preset clothes, obtaining a picture of the internal space of the washing machine in the intelligent washing machine, wherein the picture is shot by the intelligent camera;
judging whether the intelligent washing machine comprises foreign matter materials or not based on the picture of the internal space of the washing machine, wherein the foreign matter materials are materials except clothes materials and clothes matching materials;
and if the intelligent washing machine comprises foreign matter materials, sending an alarm message to the intelligent terminal, wherein the foreign matter alarm message is used for reminding a user that foreign matters exist in the intelligent washing machine.
In a possible embodiment, the method further comprises:
and if the intelligent washing machine does not comprise foreign matter materials, starting the intelligent washing machine to start to wash the preset clothes.
In a possible embodiment, the determining whether the intelligent washing machine includes the foreign material based on the picture of the internal space of the washing machine includes:
acquiring image characteristics of the picture of the internal space of the washing machine, wherein the image characteristics include, but are not limited to, at least one of the following: color features, texture features, shape features, and spatial relationship features;
and judging whether the intelligent washing machine comprises foreign matter materials or not based on the image characteristics.
In a possible embodiment, after the starting of the intelligent washing machine to start washing the preset clothes, the method further includes:
after the intelligent washing machine finishes washing the preset clothes, acquiring a preset clothes picture shot by the intelligent camera;
judging whether the clothes comprise foams or stains or not based on the preset clothes picture;
if the clothes comprise foams or stains, sending a cleaning incomplete notification message to the intelligent terminal, wherein the cleaning incomplete notification message is used for reminding the intelligent terminal that the preset clothes are not cleaned.
In a possible embodiment, after sending the cleaning incomplete notification message to the intelligent terminal, the method further includes:
receiving a secondary cleaning instruction message sent by the intelligent terminal, wherein the secondary cleaning instruction message is used for instructing the intelligent washing machine to start a secondary cleaning function to start secondary cleaning of the preset clothes;
starting to wash the preset laundry for a second time based on the second washing indication message;
judging whether the clothes comprise foams or stains or not based on the preset clothes picture;
and if the clothes do not contain foam or stain, sending a cleaning completion notification message to the intelligent terminal, wherein the cleaning completion notification message is used for reminding the intelligent terminal that the preset clothes are cleaned.
In a possible embodiment, the intelligent washing machine further includes detecting whether foreign objects exist in the clothes based on X-rays or infrared rays, and the user may select a different mode to detect the foreign objects before washing the clothes.
In a second aspect, an embodiment of the present invention provides an intelligent washing machine, where the intelligent washing machine is applied to a foreign object alarm system based on an image recognition technology, the foreign object alarm system based on the image recognition technology includes an intelligent washing machine, an intelligent camera and an intelligent terminal, and the intelligent washing machine includes:
the intelligent washing machine comprises an acquisition module, a storage module and a control module, wherein the acquisition module is used for acquiring a washing machine internal space picture inside the intelligent washing machine shot by the intelligent camera before the intelligent washing machine washes preset clothes;
the judging module is used for judging whether the intelligent washing machine comprises foreign matter materials or not based on the picture of the internal space of the washing machine, wherein the foreign matter materials are materials except for clothes materials and clothes matching materials;
and the sending module is used for sending an alarm message to the intelligent terminal if the intelligent washing machine comprises foreign matter materials, and the foreign matter alarm message is used for reminding a user of the existence of foreign matters in the intelligent washing machine.
In a possible embodiment, the intelligent washing machine further comprises:
and the starting module is used for starting the intelligent washing machine to start to clean the preset clothes if the intelligent washing machine does not comprise foreign matter materials.
In a possible embodiment, the determining module is specifically configured to:
acquiring image characteristics of the picture of the internal space of the washing machine, wherein the image characteristics include, but are not limited to, at least one of the following: color features, texture features, shape features, and spatial relationship features;
and judging whether the intelligent washing machine comprises foreign matter materials or not based on the image characteristics.
In a possible embodiment, the obtaining module is further configured to obtain a preset clothes picture taken by the intelligent camera after the intelligent washing machine finishes washing the preset clothes;
the judging module is also used for judging whether the clothes comprise foams or stains or not based on the preset clothes picture;
the sending module is further configured to send a cleaning uncompleted notification message to the intelligent terminal if the clothes include foam or stains, wherein the cleaning uncompleted notification message is used for reminding the intelligent terminal that the preset clothes are not cleaned.
In a possible embodiment, the intelligent washing machine further includes a receiving module, configured to receive a secondary washing instruction message sent by the intelligent terminal, where the secondary washing instruction message is used to instruct the intelligent washing machine to start a secondary washing function to start secondary washing of the preset laundry;
the starting module is also used for starting to wash the preset clothes for the second time based on the second washing indication message;
the judging module is also used for judging whether the clothes comprise foams or stains or not based on the preset clothes picture;
the sending module is further configured to send a cleaning completion notification message to the intelligent terminal if the clothes do not include foam or stain, where the cleaning completion notification message is used to remind the intelligent terminal that the preset clothes are cleaned.
In a possible embodiment, the intelligent washing machine further includes detecting whether foreign objects exist in the clothes based on X-rays or infrared rays, and the user may select a different mode to detect the foreign objects before washing the clothes.
It can be seen that in the technical solution provided by the embodiment of the present invention, before the intelligent washing machine washes preset clothes, the internal space picture of the washing machine inside the intelligent washing machine, which is taken by the intelligent camera, is obtained; judging whether the intelligent washing machine comprises foreign matter materials or not based on the picture of the internal space of the washing machine; and if the intelligent washing machine comprises foreign matter materials, sending an alarm message to the intelligent terminal, wherein the foreign matter alarm message is used for reminding a user that foreign matters exist in the intelligent washing machine. By adopting the embodiment of the invention, whether foreign matters exist in the clothes is judged by analyzing the pictures of the internal space of the washing machine collected by the intelligent camera, and an alarm is given in time, so that the clothes washing effect is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a network architecture diagram of a foreign object alarm system based on image recognition technology according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of a foreign object alarm method based on an image recognition technology according to an embodiment of the present invention;
fig. 3 is a schematic flow chart of another foreign object alarm method based on image recognition technology according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of an intelligent washing machine according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of another intelligent washing machine according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The following are detailed below.
The terms "first," "second," "third," and "fourth," etc. in the description and claims of the invention and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Embodiments of the present application are described below with reference to the drawings.
The embodiment of the invention provides a foreign matter alarm method based on an image recognition technology, which is applied to a foreign matter detection system based on the image recognition technology, wherein the foreign matter alarm system based on the image recognition technology comprises an intelligent washing machine, an intelligent camera and an intelligent terminal, the intelligent camera and the intelligent terminal are arranged in the intelligent washing machine, and the method comprises the following steps: before the intelligent washing machine washes preset clothes, obtaining a picture of the internal space of the washing machine in the intelligent washing machine, wherein the picture is shot by the intelligent camera; judging whether the intelligent washing machine comprises foreign matter materials or not based on the picture of the internal space of the washing machine, wherein the foreign matter materials are materials except clothes materials and clothes matching materials; and if the intelligent washing machine comprises foreign matter materials, sending an alarm message to the intelligent terminal, wherein the foreign matter alarm message is used for reminding a user that foreign matters exist in the intelligent washing machine.
Referring to fig. 1, fig. 1 is a network architecture diagram of a foreign object alarm system based on an image recognition technology according to an embodiment of the present invention, where the foreign object alarm system based on the image recognition technology includes an intelligent washing machine 100 and an intelligent terminal 200.
Wherein, this intelligent washing machine 100 is inside to include an intelligent camera, and this intelligent camera can shoot the picture including the clothes among the intelligent washing machine, and this intelligent washing machine has the image recognition function, can detect whether there is the foreign matter in the clothes of intelligence laundry based on image recognition technology to the clothes in the intelligence laundry has sent the warning to the user when there is the foreign matter, carries out the cleanness after reminding the user to take out the foreign matter in the intelligence laundry.
Alternatively, the image recognition process may be integrated in the intelligent camera or may be performed by the controller of the intelligent washing machine.
The intelligent terminal 200 is a terminal device capable of communicating with the intelligent washing machine, and may be an intelligent terminal such as a mobile phone and a tablet computer.
In the embodiment, when the intelligent washing machine detects that foreign matters exist in clothes, an alarm is sent to the intelligent terminal, so that the intelligent washing machine can be further controlled by the intelligent terminal.
The foreign matter detection method provided by the embodiment of the invention is realized based on the foreign matter alarm system based on the image recognition technology. Specifically, referring to fig. 2, fig. 2 is a schematic flowchart of a foreign object alarm method based on an image recognition technology according to an embodiment of the present invention, including the following steps:
s201, before the intelligent washing machine washes preset clothes, obtaining a picture of the internal space of the washing machine inside the intelligent washing machine, wherein the picture is shot by the intelligent camera.
The picture of the internal space of the washing machine refers to a picture of clothes to be washed in the washing machine, so that whether foreign matters are contained in the intelligent washing machine or not can be judged through the picture of the internal space of the washing machine.
Optionally, in an embodiment of the present invention, before the intelligent washing machine washes preset clothes, the intelligent washing machine rotates at a preset speed, and in the process, a picture of the washing machine internal space inside the intelligent washing machine, which is taken by the intelligent camera, is obtained at a preset time interval.
In the embodiment of the invention, the preset speed is a slower speed, so that when foreign matters such as a mobile phone exist in the intelligent washing machine, the mobile phone is not damaged, and meanwhile, the intelligent camera can fully shoot pictures of the internal space of the washing machine including clothes from various angles by rotating at the slower speed. Alternatively, the preset time may be 1 second.
S202, judging whether the intelligent washing machine comprises foreign matter materials or not based on the picture of the internal space of the washing machine, wherein the foreign matter materials are materials except clothes materials and clothes matching materials;
in the embodiment of the invention, the material of the clothes accessory can be the material of objects such as buttons and the like, the material except the material of the clothes and the material of the clothes accessory can be metal or other materials which are forgotten to be taken out when a user puts the clothes in a pocket, for example, a mobile phone or a paper towel and the like, and because the metal and the material of the clothes are different, whether other objects exist in the clothes can be judged by the material of the objects placed in the washing machine, so that the objects can be taken out before the washing machine formally starts to wash the clothes, the objects such as the mobile phone and the like are prevented from being damaged due to the rotation of a drum, the washing machine can be prevented from being injured, or when the foreign object is the paper towel, the paper towel can be. Therefore, the foreign material is a material other than the material of the clothing accessory and the material of the clothing itself.
Optionally, in an embodiment of the present invention, the determining whether the intelligent washing machine includes a foreign material based on the picture of the internal space of the washing machine includes:
acquiring image characteristics of the picture of the internal space of the washing machine, wherein the image characteristics include, but are not limited to, at least one of the following: color features, texture features, shape features, and spatial relationship features;
and judging whether the intelligent washing machine comprises foreign matter materials or not based on the image characteristics.
Specifically, in an embodiment of the present invention, a first image feature database including color features, texture features, shape features, and spatial relationship features of materials of clothes and clothes accessories may be stored in a preset database, so that when one or more of the color features, the texture features, the shape features, and the spatial relationship features of an internal space picture of a washing machine are obtained, whether the features belong to the first image feature database is determined, if the features belong to the first image feature database, it is determined that the materials included in the washing machine are all the materials of the clothes or the clothes accessories, and if some of the features do not belong to the first image feature database, it is determined that the intelligent washing machine may include other materials except the materials of the clothes or the clothes accessories. It can be understood that the judgment of whether the picture of the inner space of the washing machine comprises the foreign matter material or not through one or more image characteristics is more accurate in use judgment.
Optionally, in an embodiment of the present invention, a second image feature database including color features, texture features, shape features, and spatial relationship features of common metal foreign objects such as mobile phones, paper towels, and other foreign objects may be further stored in the preset database, so that when one or more of the color features, texture features, shape features, and spatial relationship features of the internal space picture of the washing machine are acquired and it is determined that the features do not belong to the first image feature database, it is further determined whether the features are included in the second image feature database, and if so, it may be determined that the material is a foreign object. It can be understood that whether the image features not included in the first image feature database are included in the second image feature database is further determined to determine whether the image includes materials other than the materials of the clothes and the clothes accessories, so that the determination is more accurate.
S203, if the intelligent washing machine comprises foreign matter materials, sending a foreign matter alarm message to the intelligent terminal, wherein the foreign matter alarm message is used for reminding a user that foreign matters exist in the intelligent washing machine.
Specifically, in an embodiment of the present invention, an application program may be installed on a mobile phone, then the intelligent washing machine is controlled to start a foreign object alarm function based on an image recognition technology on the application program, and then when a foreign object is detected in the intelligent washing machine, a foreign object alarm message is sent to the mobile phone through the application program, and optionally, the foreign object alarm message may be sent in a form of text reminding.
Further, the foreign matter alarm message may further include the kind of the foreign matter determined by the image recognition technology-based method, so that the user may further determine whether the laundry needs to be washed after the foreign matter is removed or continuously washed.
Optionally, in an embodiment of the present invention, if the intelligent washing machine does not include a foreign material, the intelligent washing machine is started to start washing the preset clothes.
Optionally, in an embodiment of the present invention, the foreign matter alarm message further includes a picture of the internal space of the washing machine, so that the user can more intuitively view the clothes inside the washing machine to make a next decision.
Optionally, in an embodiment of the present invention, after the sending the foreign object alarm message to the intelligent terminal, the method further includes:
receiving a foreign matter removing instruction sent by the intelligent terminal, wherein the foreign matter removing instruction is used for indicating that the intelligent washing machine does not comprise materials except the materials of clothes and the materials of clothes accessories;
and starting a water discharging washing mode of the intelligent washing machine based on the foreign matter removing instruction.
The foreign matter removing instruction is that after the user receives the foreign matter alarm message, when the user determines that the washing can be continued through the type of the foreign matter in the alarm message or determines that the washing can be continued through the internal picture of the washing machine carried in the alarm message, the foreign matter does not need to be taken out at the moment, and the intelligent washing machine can be instructed to continue washing, draining and washing through the instruction.
For example, in an example of the present invention, when a material other than the materials of the clothes and the clothes accessories is detected in the intelligent washing machine, in order to enable the user to more clearly view the situation in the washing machine at this time, an internal picture of the washing machine may be further taken through the camera, and the picture may be carried when a foreign object alarm message is sent to the intelligent terminal.
Furthermore, at this time, a camera in the intelligent washing machine is started to take a picture of the interior of the washing machine, and the picture is sent to the intelligent terminal through the application program, and then after the user watches the picture of the interior of the washing machine, if the user judges that no foreign matter exists in the interior of the washing machine through the picture of the interior of the washing machine, the user can send a foreign matter removing instruction through the application program so that the washing machine enters a water discharging washing mode in order to prevent the washing machine from stopping working.
Or, the foreign matter removing instruction may be that after the intelligent terminal receives the foreign matter alarm message sent by the intelligent washing machine, the intelligent terminal manually removes the foreign matter in the washing machine, and then sends the foreign matter removing instruction to the intelligent washing machine through the application program, so that the intelligent washing machine can continue to start the water-discharging washing mode.
Optionally, in some embodiments of the present invention, after the intelligent washing machine includes the foreign material therein, the method further includes:
stopping the action of rotating the clothes at the preset speed.
In the embodiment of the invention, if the foreign matter is detected to exist in the intelligent washing machine, the clothes are stopped to rotate at the moment, so that a user can take out the foreign matter.
Optionally, in an embodiment of the present invention, after the starting of the intelligent washing machine to start washing the preset clothes, the method further includes:
after the intelligent washing machine finishes washing the preset clothes, acquiring a preset clothes picture shot by the intelligent camera;
judging whether the clothes comprise foams or stains or not based on the preset clothes picture;
if the clothes comprise foams or stains, sending a cleaning incomplete notification message to the intelligent terminal, wherein the cleaning incomplete notification message is used for reminding the intelligent terminal that the preset clothes are not cleaned.
In the embodiment of the invention, in order to clean clothes, after the clothes are washed, an intelligent camera of the washing machine is further used for shooting the picture inside the washing machine, and then the image recognition technology is used again for judging whether the picture contains foam or dirt. Specifically, the determination may also be performed by one or more of a color feature, a texture feature, a shape feature, and a spatial relationship feature, where the determination method is similar to the method for determining whether a foreign object exists in the internal space picture of the washing machine, and is not described herein again, if the image includes foam or dirt, it indicates that the washing is not clean, the user is prompted to further start the washing mode, or after the intelligent washing machine sends the washing incompletion notification message to the mobile phone terminal, the user may directly determine and instruct the intelligent washing machine to wash again at the mobile phone terminal.
Optionally, in an embodiment of the present invention, the picture of the internal space of the washing machine taken by the intelligent camera may also be directly sent to the user terminal at this time, for example, sent to the user terminal through a specific application program, and the user determines whether the washing is completed or not, and if the washing is not completed, the user may restart the intelligent washing machine through the application program to perform secondary washing.
Optionally, in an embodiment of the present invention, the secondary cleaning includes two modes, when it is determined from the picture of the internal space of the washing machine that stains still exist in the clothes, the secondary cleaning includes re-washing, and if it is determined that stains do not exist in the clothes at this time and only bubbles exist, only the clothes need to be cleaned.
It can be understood that whether the clothes are washed clean or not can be judged by simultaneously utilizing the image recognition technology embedded into the intelligent washing machine, and the washing of the clothes can be ensured.
Optionally, in an embodiment of the present invention, after sending the cleaning incomplete notification message to the intelligent terminal, the method further includes:
receiving a secondary cleaning instruction message sent by the intelligent terminal, wherein the secondary cleaning instruction message is used for instructing the intelligent washing machine to start a secondary cleaning function to start secondary cleaning of the preset clothes;
starting to wash the preset laundry for a second time based on the second washing indication message;
judging whether the clothes comprise foams or stains or not based on the preset clothes picture;
and if the clothes do not contain foam or stain, sending a cleaning completion notification message to the intelligent terminal, wherein the cleaning completion notification message is used for reminding the intelligent terminal that the preset clothes are cleaned.
For example, in an embodiment of the present invention, after the intelligent washing machine finishes washing clothes, a washing completion message is sent to the intelligent terminal, where the washing completion message may include a picture of clothes inside the washing machine, then if the user feels that the clothes need to be washed again, then a secondary washing instruction message may be further sent to the intelligent washing machine through the intelligent terminal, then after the intelligent washing machine finishes washing the clothes for the second time, the intelligent washing machine may obtain the preset picture of the clothes at this time and judge whether the clothes in the washing are washed completely, and after it is determined that the clothes in the washing are washed completely, a washing completion message is sent to the intelligent terminal, and then the washing is completed.
It can be understood that whether the clothes are washed clean or not is further judged through secondary washing and clothes pictures in the washing machine, and the cleanness of the clothes can be guaranteed.
Optionally, in an embodiment of the present invention, the intelligent washing machine further includes detecting whether there is a foreign object in the clothes based on X-ray or infrared ray, and the user may select a different mode to detect the foreign object before washing the clothes.
It can be seen that in the technical solution provided by the embodiment of the present invention, before the intelligent washing machine washes preset clothes, the internal space picture of the washing machine inside the intelligent washing machine, which is taken by the intelligent camera, is obtained; judging whether the intelligent washing machine comprises foreign matter materials or not based on the picture of the internal space of the washing machine, wherein the foreign matter materials are materials except clothes materials and clothes matching materials; and if the intelligent washing machine comprises the foreign matter material, sending a foreign matter alarm message to the intelligent terminal, wherein the foreign matter alarm message is used for reminding a user of the existence of the foreign matter in the intelligent washing machine. Therefore, whether foreign matters exist in the intelligent washing machine can be accurately detected before clothes washing, so that a user can be timely reminded when the foreign matters exist in the intelligent washing machine, and damage caused by cleaning of the foreign matters such as a mobile phone is prevented.
Referring to fig. 3, fig. 3 is a schematic flow chart of another foreign object alarm method based on an image recognition technology according to an embodiment of the present invention. In the method shown in fig. 3, the same or similar contents as those in the method shown in fig. 2 may refer to the detailed description in fig. 3, and are not repeated here. As shown in fig. 3, the foreign object alarm method based on the image recognition technology may include the following steps:
s301, before the intelligent washing machine washes preset clothes, obtaining the picture of the internal space of the washing machine inside the intelligent washing machine, wherein the picture is shot by the intelligent camera.
S302, obtaining image characteristics of the picture of the internal space of the washing machine, wherein the image characteristics include but are not limited to at least one of the following: color features, texture features, shape features, and spatial relationship features.
S303, judging whether the intelligent washing machine comprises foreign matter materials or not based on the image characteristics, wherein the foreign matter materials are materials except clothes materials and clothes matching materials.
S304, if the intelligent washing machine comprises foreign matter materials, sending a foreign matter alarm message to the intelligent terminal, wherein the foreign matter alarm message is used for reminding a user that foreign matters exist in the intelligent washing machine.
It can be seen that in the technical solution provided by the embodiment of the present invention, before the intelligent washing machine washes preset clothes, the internal space picture of the washing machine inside the intelligent washing machine, which is taken by the intelligent camera, is obtained; judging whether the intelligent washing machine comprises foreign matter materials or not based on the picture of the internal space of the washing machine, wherein the foreign matter materials are materials except clothes materials and clothes matching materials; and if the intelligent washing machine comprises the foreign matter material, sending a foreign matter alarm message to the intelligent terminal, wherein the foreign matter alarm message is used for reminding a user of the existence of the foreign matter in the intelligent washing machine. Therefore, whether foreign matters exist in the intelligent washing machine can be accurately detected before clothes washing, so that a user can be timely reminded when the foreign matters exist in the intelligent washing machine, and damage caused by cleaning of the foreign matters such as a mobile phone is prevented.
The embodiment of the present invention further provides an intelligent washing machine, which is applied to a foreign object alarm system based on an image recognition technology, wherein the foreign object alarm system based on the image recognition technology comprises the intelligent washing machine, an intelligent camera and an intelligent terminal, the intelligent washing machine comprises:
the intelligent washing machine comprises an acquisition module, a storage module and a control module, wherein the acquisition module is used for acquiring a washing machine internal space picture inside the intelligent washing machine shot by the intelligent camera before the intelligent washing machine washes preset clothes;
the judging module is used for judging whether the intelligent washing machine comprises foreign matter materials or not based on the picture of the internal space of the washing machine, wherein the foreign matter materials are materials except for clothes materials and clothes matching materials;
and the sending module is used for sending a foreign matter alarm message to the intelligent terminal if the intelligent washing machine comprises a foreign matter material, wherein the foreign matter alarm message is used for reminding a user of the existence of a foreign matter in the intelligent washing machine.
Specifically, referring to fig. 4, fig. 4 is a schematic structural diagram of an intelligent washing machine according to an embodiment of the present invention, where the intelligent washing machine is applied to a foreign object detection system and a foreign object alarm system based on an image recognition technology, and the foreign object alarm system based on the image recognition technology includes an intelligent washing machine, an intelligent camera and an intelligent terminal, and is used to implement the foreign object alarm method based on the image recognition technology disclosed in the embodiment of the present invention. Among them, as shown in fig. 4, the intelligent washing machine 400 may include:
an obtaining module 410, configured to obtain a picture of an internal space of the washing machine inside the intelligent washing machine, which is taken by the intelligent camera, before the intelligent washing machine washes preset clothes.
The picture of the internal space of the washing machine refers to a picture of clothes to be washed in the washing machine, so that whether foreign matters are contained in the intelligent washing machine or not can be judged through the picture of the internal space of the washing machine.
Optionally, in an embodiment of the present invention, before the intelligent washing machine washes preset clothes, the intelligent washing machine rotates at a preset speed, and in the process, a picture of the washing machine internal space inside the intelligent washing machine, which is taken by the intelligent camera, is obtained at a preset time interval.
In the embodiment of the invention, the preset speed is a slower speed, so that when foreign matters such as a mobile phone exist in the intelligent washing machine, the mobile phone is not damaged, and meanwhile, the intelligent camera can fully shoot pictures of the internal space of the washing machine including clothes from various angles by rotating at the slower speed. Alternatively, the preset time may be 1 second.
A judging module 420, configured to judge whether the intelligent washing machine includes a foreign substance material based on the washing machine internal space picture, where the foreign substance material is a material other than a clothes material and a clothes collocation material.
In the embodiment of the invention, the material of the clothes accessory can be the material of objects such as buttons and the like, the material except the material of the clothes and the material of the clothes accessory can be metal or other materials which are forgotten to be taken out when a user puts the clothes in a pocket, for example, a mobile phone or a paper towel and the like, and because the metal and the material of the clothes are different, whether other objects exist in the clothes can be judged by the material of the objects placed in the washing machine, so that the objects can be taken out before the washing machine formally starts to wash the clothes, the objects such as the mobile phone and the like are prevented from being damaged due to the rotation of a drum, the washing machine can be prevented from being injured, or when the foreign object is the paper towel, the paper towel can be. Therefore, the foreign material is a material other than the material of the clothing accessory and the material of the clothing itself.
Optionally, in an embodiment of the present invention, the determining module 420 is specifically configured to:
acquiring image characteristics of the picture of the internal space of the washing machine, wherein the image characteristics include, but are not limited to, at least one of the following: color features, texture features, shape features, and spatial relationship features;
and judging whether the intelligent washing machine comprises foreign matter materials or not based on the image characteristics.
Specifically, in an embodiment of the present invention, a first image feature database including color features, texture features, shape features, and spatial relationship features of materials of clothes and clothes accessories may be stored in a preset database, so that when one or more of the color features, the texture features, the shape features, and the spatial relationship features of an internal space picture of a washing machine are obtained, whether the features belong to the first image feature database is determined, if the features belong to the first image feature database, it is determined that the materials included in the washing machine are all the materials of the clothes or the clothes accessories, and if some of the features do not belong to the first image feature database, it is determined that the intelligent washing machine may include other materials except the materials of the clothes or the clothes accessories. It can be understood that the judgment of whether the picture of the inner space of the washing machine comprises the foreign matter material or not through one or more image characteristics is more accurate in use judgment.
Optionally, in an embodiment of the present invention, a second image feature database including color features, texture features, shape features, and spatial relationship features of common metal foreign objects such as mobile phones, paper towels, and other foreign objects may be further stored in the preset database, so that when one or more of the color features, texture features, shape features, and spatial relationship features of the internal space picture of the washing machine are acquired and it is determined that the features do not belong to the first image feature database, it is further determined whether the features are included in the second image feature database, and if so, it may be determined that the material is a foreign object. It can be understood that whether the image features not included in the first image feature database are included in the second image feature database is further determined to determine whether the image includes materials other than the materials of the clothes and the clothes accessories, so that the determination is more accurate.
And the sending module 430 is configured to send a foreign matter alarm message to the intelligent terminal if the intelligent washing machine comprises a foreign matter material, where the foreign matter alarm message is used to remind a user that a foreign matter exists in the intelligent washing machine.
Specifically, in an embodiment of the present invention, an application program may be installed on a mobile phone, then the intelligent washing machine is controlled to start a foreign object alarm function based on an image recognition technology on the application program, and then when a foreign object is detected in the intelligent washing machine, a foreign object alarm message is sent to the mobile phone through the application program, and optionally, the foreign object alarm message may be sent in a form of text reminding.
Further, the foreign matter alarm message may further include the kind of the foreign matter determined by the image recognition technology-based method, so that the user may further determine whether the laundry needs to be washed after the foreign matter is removed or continuously washed.
Optionally, in an embodiment of the present invention, the intelligent washing machine 400 further includes:
a starting module 440, configured to start the intelligent washing machine to start to wash the preset clothes if the intelligent washing machine does not include foreign materials.
Optionally, in an embodiment of the present invention, the foreign matter alarm message further includes a picture of the internal space of the washing machine, so that the user can more intuitively view the clothes inside the washing machine to make a next decision.
Optionally, in an embodiment of the present invention, after sending the foreign object alarm message to the intelligent terminal, the intelligent terminal is further configured to:
receiving a foreign matter removing instruction sent by the intelligent terminal, wherein the foreign matter removing instruction is used for indicating that the intelligent washing machine does not comprise materials except the materials of clothes and the materials of clothes accessories;
and starting a water discharging washing mode of the intelligent washing machine based on the foreign matter removing instruction.
The foreign matter removing instruction is that after the user receives the foreign matter alarm message, when the user determines that the washing can be continued through the type of the foreign matter in the alarm message or determines that the washing can be continued through the internal picture of the washing machine carried in the alarm message, the foreign matter does not need to be taken out at the moment, and the intelligent washing machine can be instructed to continue washing, draining and washing through the instruction.
For example, in an example of the present invention, when a material other than the materials of the clothes and the clothes accessories is detected in the intelligent washing machine, in order to enable the user to more clearly view the situation in the washing machine at this time, an internal picture of the washing machine may be further taken through the camera, and the picture may be carried when a foreign object alarm message is sent to the intelligent terminal.
Furthermore, at this time, a camera in the intelligent washing machine is started to take a picture of the interior of the washing machine, and the picture is sent to the intelligent terminal through the application program, and then after the user watches the picture of the interior of the washing machine, if the user judges that no foreign matter exists in the interior of the washing machine through the picture of the interior of the washing machine, the user can send a foreign matter removing instruction through the application program so that the washing machine enters a water discharging washing mode in order to prevent the washing machine from stopping working.
Or, the foreign matter removing instruction may be that after the intelligent terminal receives the foreign matter alarm message sent by the intelligent washing machine, the intelligent terminal manually removes the foreign matter in the washing machine, and then sends the foreign matter removing instruction to the intelligent washing machine through the application program, so that the intelligent washing machine can continue to start the water-discharging washing mode.
Optionally, in some embodiments of the present invention, after the foreign material is included in the intelligent washing machine, the intelligent washing machine is further configured to stop the action of rotating the clothes using the preset speed.
In the embodiment of the invention, if the foreign matter is detected to exist in the intelligent washing machine, the clothes are stopped to rotate at the moment, so that a user can take out the foreign matter.
Optionally, in an embodiment of the present invention, the obtaining module 410 is further configured to obtain a preset clothes picture taken by the intelligent camera after the intelligent washing machine finishes washing the preset clothes;
the judging module 420 is further configured to judge whether the clothes include foam or stains based on the preset clothes picture;
the sending module 430 is further configured to send a cleaning incomplete notification message to the intelligent terminal if the clothes include foam or stains, where the cleaning incomplete notification message is used to remind the intelligent terminal that the preset clothes are not cleaned.
In the embodiment of the invention, in order to clean clothes, after the clothes are washed, an intelligent camera of the washing machine is further used for shooting the picture inside the washing machine, and then the image recognition technology is used again for judging whether the picture contains foam or dirt. Specifically, the determination may also be performed by one or more of a color feature, a texture feature, a shape feature, and a spatial relationship feature, where the determination method is similar to the method for determining whether a foreign object exists in the internal space picture of the washing machine, and is not described herein again, if the image includes foam or dirt, it indicates that the washing is not clean, the user is prompted to further start the washing mode, or after the intelligent washing machine sends the washing incompletion notification message to the mobile phone terminal, the user may directly determine and instruct the intelligent washing machine to wash again at the mobile phone terminal.
Optionally, in an embodiment of the present invention, the picture of the internal space of the washing machine taken by the intelligent camera may also be directly sent to the user terminal at this time, for example, sent to the user terminal through a specific application program, and the user determines whether the washing is completed or not, and if the washing is not completed, the user may restart the intelligent washing machine through the application program to perform secondary washing.
Optionally, in an embodiment of the present invention, the secondary cleaning includes two modes, when it is determined from the picture of the internal space of the washing machine that stains still exist in the clothes, the secondary cleaning includes re-washing, and if it is determined that stains do not exist in the clothes at this time and only bubbles exist, only the clothes need to be cleaned.
It can be understood that whether the clothes are washed clean or not can be judged by simultaneously utilizing the image recognition technology embedded into the intelligent washing machine, and the washing of the clothes can be ensured.
Optionally, in an embodiment of the present invention, the intelligent washing machine further includes a receiving module 450, configured to receive a secondary washing instruction message sent by the intelligent terminal, where the secondary washing instruction message is used to instruct the intelligent washing machine to start a secondary washing function to start secondary washing of the preset laundry;
the starting module 440 is further configured to start the secondary washing of the preset laundry based on the secondary washing indication message;
the judging module 420 is further configured to judge whether the clothes include foam or stains based on the preset clothes picture;
the sending module 430 is further configured to send a cleaning completion notification message to the intelligent terminal if the clothes do not include foam or stain, where the cleaning completion notification message is used to remind the intelligent terminal that the preset clothes are cleaned.
For example, in an embodiment of the present invention, after the intelligent washing machine finishes washing clothes, a washing completion message is sent to the intelligent terminal, where the washing completion message may include a picture of clothes inside the washing machine, then if the user feels that the clothes need to be washed again, then a secondary washing instruction message may be further sent to the intelligent washing machine through the intelligent terminal, then after the intelligent washing machine finishes washing the clothes for the second time, the intelligent washing machine may obtain the preset picture of the clothes at this time and judge whether the clothes in the washing are washed completely, and after it is determined that the clothes in the washing are washed completely, a washing completion message is sent to the intelligent terminal, and then the washing is completed.
It can be understood that whether the clothes are washed clean or not is further judged through secondary washing and clothes pictures in the washing machine, and the cleanness of the clothes can be guaranteed.
Optionally, in an embodiment of the present invention, the intelligent washing machine further includes detecting whether there is a foreign object in the clothes based on X-ray or infrared ray, and the user may select a different mode to detect the foreign object before washing the clothes.
It can be seen that, in the technical solution provided in the embodiment of the present invention, before the intelligent washing machine 400 washes preset clothes, the internal space picture of the washing machine inside the intelligent washing machine, which is taken by the intelligent camera, is obtained; judging whether the intelligent washing machine comprises foreign matter materials or not based on the picture of the internal space of the washing machine, wherein the foreign matter materials are materials except clothes materials and clothes matching materials; if the intelligent washing machine 400 comprises foreign matter materials, sending a foreign matter alarm message to the intelligent terminal, wherein the foreign matter alarm message is used for reminding a user that foreign matters exist in the intelligent washing machine 400. Therefore, whether foreign matters exist in the intelligent washing machine can be accurately detected before clothes washing, so that a user can be timely reminded when the foreign matters exist in the intelligent washing machine, and damage caused by cleaning of the foreign matters such as a mobile phone is prevented.
It should be noted that the above modules (the obtaining module 410, the judging module 420, the sending module 430, and the starting module 440) are used for executing relevant steps of the above method.
In the present embodiment, the cell management server 400 is presented in the form of a module. A "module" herein may refer to an application-specific integrated circuit (ASIC), a processor and memory that execute one or more software or firmware programs, an integrated logic circuit, and/or other devices that may provide the described functionality. In addition, the above acquiring module 410, the judging module 420, the transmitting module 430 and the starting module 440 may be implemented by the processor 501 of the intelligent washing machine 500 shown in fig. 5.
Referring to fig. 5, fig. 5 is a schematic structural diagram of another intelligent washing machine according to an embodiment of the present invention. As shown in fig. 5, the intelligent washing machine 500 may be implemented in the structure of fig. 5, and the intelligent washing machine 500 includes at least one processor 501, at least one memory 502 and at least one communication interface 503. The processor 501, the memory 502 and the communication interface 503 are connected through the communication bus and complete communication with each other.
The processor 501 may be a general purpose Central Processing Unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of programs according to the above schemes.
Communication interface 503 is used for communicating with other devices or communication Networks, such as ethernet, Radio Access Network (RAN), Wireless Local Area Networks (WLAN), etc.
The Memory 502 may be, but is not limited to, a Read-Only Memory (ROM) or other type of static storage device that can store static information and instructions, a Random Access Memory (RAM) or other type of dynamic storage device that can store information and instructions, an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Compact Disc Read-Only Memory (CD-ROM) or other optical Disc storage, optical Disc storage (including Compact Disc, laser Disc, optical Disc, digital versatile Disc, blu-ray Disc, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory may be self-contained and coupled to the processor via a bus. The memory may also be integral to the processor.
The memory 502 is used for storing application program codes for executing the above scheme, and is controlled by the processor 501 for execution. The processor 501 is used to execute application program code stored in the memory 502.
The code stored in the memory 502 may perform the above-provided foreign object alarm method based on the image recognition technology, for example, before the intelligent washing machine washes preset clothes, a picture of the internal space of the intelligent washing machine taken by the intelligent camera is obtained; judging whether the intelligent washing machine comprises foreign matter materials or not based on the picture of the internal space of the washing machine, wherein the foreign matter materials are materials except clothes materials and clothes matching materials; and if the intelligent washing machine comprises the foreign matter material, sending a foreign matter alarm message to the intelligent terminal, wherein the foreign matter alarm message is used for reminding a user of the existence of the foreign matter in the intelligent washing machine.
An embodiment of the present invention further provides a computer storage medium, where the computer storage medium may store a program, and the program includes some or all of the steps of any one of the foreign object alarm methods based on the image recognition technology described in the above method embodiments when executed.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a memory and includes several instructions for causing a computer device (which may be a personal computer, an internet of things server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The above embodiments of the present invention are described in detail, and the principle and the implementation of the present invention are explained by applying specific embodiments, and the above description of the embodiments is only used to help understanding the method of the present invention and the core idea thereof; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in view of the above, the content of the present specification should not be construed as a limitation to the present invention.

Claims (8)

1. A foreign matter alarm method based on an image recognition technology is characterized in that the method is applied to a foreign matter alarm system based on the image recognition technology, the foreign matter alarm system based on the image recognition technology comprises an intelligent washing machine, an intelligent camera and an intelligent terminal, the intelligent camera is arranged in the intelligent washing machine, and the method comprises the following steps:
before the intelligent washing machine washes preset clothes, the intelligent washing machine is rotated at a preset speed, and pictures of the internal space of the washing machine, which are shot by the intelligent camera from various angles, in the intelligent washing machine are obtained at intervals of preset time;
storing a first image feature database comprising color features, texture features, shape features and spatial relationship features of materials of clothes and clothes accessories in a preset database, acquiring various features of the color features, the texture features, the shape features and the spatial relationship features of a space picture in the intelligent washing machine, judging whether the features belong to the first image feature database, if so, determining that the materials contained in the intelligent washing machine are all the materials of the clothes or the clothes accessories, if abnormal features which do not belong to the first image feature database exist in the features, storing a second image feature database comprising the color features, the texture features, the shape features and the spatial relationship features of foreign matters in the preset database, and judging whether the abnormal features belong to the second image feature database, if the intelligent washing machine belongs to the intelligent washing machine, determining that the intelligent washing machine comprises foreign matter materials;
and if the intelligent washing machine comprises the foreign matter material, sending a foreign matter alarm message to the intelligent terminal, wherein the foreign matter alarm message is used for reminding a user of the existence of the foreign matter in the intelligent washing machine.
2. The method of claim 1, further comprising:
and if the intelligent washing machine does not comprise foreign matter materials, starting the intelligent washing machine to start to wash the preset clothes.
3. The method according to claim 2, wherein after the activating the intelligent washing machine to start washing the preset clothes, the method further comprises:
after the intelligent washing machine finishes washing the preset clothes, acquiring a preset clothes picture shot by the intelligent camera;
judging whether the clothes comprise foams or stains or not based on the preset clothes picture;
if the clothes comprise foams or stains, sending a cleaning incomplete notification message to the intelligent terminal, wherein the cleaning incomplete notification message is used for reminding the intelligent terminal that the preset clothes are not cleaned.
4. The method according to claim 3, wherein after sending the cleaning incompletion notification message to the intelligent terminal, the method further comprises:
receiving a secondary cleaning instruction message sent by the intelligent terminal, wherein the secondary cleaning instruction message is used for instructing the intelligent washing machine to start a secondary cleaning function to start secondary cleaning of the preset clothes;
starting to wash the preset laundry for a second time based on the second washing indication message;
judging whether the clothes comprise foams or stains or not based on the preset clothes picture;
and if the clothes do not contain foam or stain, sending a cleaning completion notification message to the intelligent terminal, wherein the cleaning completion notification message is used for reminding the intelligent terminal that the preset clothes are cleaned.
5. The utility model provides an intelligent washing machine which characterized in that, intelligent washing machine is applied to the foreign matter alarm system based on image recognition technology, the foreign matter alarm system based on image recognition technology includes intelligent washing machine, places in intelligent washing machine's intelligent camera and intelligent terminal, intelligent washing machine includes:
the intelligent washing machine comprises an acquisition module, a control module and a display module, wherein the acquisition module is used for rotating the intelligent washing machine at a preset speed before the intelligent washing machine washes preset clothes, and acquiring internal space pictures of the intelligent washing machine, which are shot by the intelligent camera from various angles at intervals of preset time;
a judging module, configured to store a first image feature database including color features, texture features, shape features, and spatial relationship features of clothes and clothes matching materials in a preset database, obtain multiple features of the color features, texture features, shape features, and spatial relationship features of an internal space picture of the washing machine, judge whether the features belong to the first image feature database, determine, if the features belong to the first image feature database, that the materials included in the intelligent washing machine are all clothes or clothes matching materials, store, in the preset database, a second image feature database including color features, texture features, shape features, and spatial relationship features of foreign matters, and judge whether the abnormal features belong to the second image feature database, if the intelligent washing machine belongs to the intelligent washing machine, determining that the intelligent washing machine comprises foreign matter materials;
and the sending module is used for sending a foreign matter alarm message to the intelligent terminal if the intelligent washing machine comprises a foreign matter material, wherein the foreign matter alarm message is used for reminding a user of the existence of a foreign matter in the intelligent washing machine.
6. The intelligent washing machine as claimed in claim 5, further comprising:
and the starting module is used for starting the intelligent washing machine to start to clean the preset clothes if the intelligent washing machine does not comprise foreign matter materials.
7. The intelligent washing machine according to claim 6, wherein the obtaining module is further configured to obtain a preset clothes picture taken by the intelligent camera after the intelligent washing machine finishes washing the preset clothes;
the judging module is also used for judging whether the clothes comprise foams or stains or not based on the preset clothes picture;
the sending module is further configured to send a cleaning uncompleted notification message to the intelligent terminal if the clothes include foam or stains, wherein the cleaning uncompleted notification message is used for reminding the intelligent terminal that the preset clothes are not cleaned.
8. The intelligent washing machine according to claim 7, further comprising a receiving module, configured to receive a secondary washing instruction message sent by the intelligent terminal, where the secondary washing instruction message is used to instruct the intelligent washing machine to start a secondary washing function to start secondary washing of the preset laundry;
the starting module is also used for starting to wash the preset clothes for the second time based on the second washing indication message;
the judging module is also used for judging whether the clothes comprise foams or stains or not based on the preset clothes picture;
the sending module is further configured to send a cleaning completion notification message to the intelligent terminal if the clothes do not include foam or stain, where the cleaning completion notification message is used to remind the intelligent terminal that the preset clothes are cleaned.
CN201710776522.4A 2017-08-31 2017-08-31 Alarm method based on image recognition technology and intelligent device Active CN107447442B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710776522.4A CN107447442B (en) 2017-08-31 2017-08-31 Alarm method based on image recognition technology and intelligent device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710776522.4A CN107447442B (en) 2017-08-31 2017-08-31 Alarm method based on image recognition technology and intelligent device

Publications (2)

Publication Number Publication Date
CN107447442A CN107447442A (en) 2017-12-08
CN107447442B true CN107447442B (en) 2020-04-10

Family

ID=60493480

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710776522.4A Active CN107447442B (en) 2017-08-31 2017-08-31 Alarm method based on image recognition technology and intelligent device

Country Status (1)

Country Link
CN (1) CN107447442B (en)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109972351A (en) * 2017-12-28 2019-07-05 南京工程学院 A kind of novel washing machine
CN109208245B (en) * 2018-09-14 2020-12-01 宁波慈溪小家电创新设计研究院有限公司 Automatic clothes washing method
CN109112774B (en) * 2018-11-12 2020-03-10 珠海格力电器股份有限公司 Control method and device of washing machine, storage medium and washing machine
CN109371633B (en) * 2018-11-29 2020-10-27 嘉兴市金鹭喷织有限公司 Foam spreading state detection system
CN109784202A (en) * 2018-12-24 2019-05-21 珠海格力电器股份有限公司 Recognition methods, device and the washing machine and computer readable storage medium of object are left in article to be washed
CN110904619A (en) * 2019-12-18 2020-03-24 珠海格力电器股份有限公司 Visual interaction method, system and device, washing machine and storage medium
CN111058233B (en) * 2019-12-18 2021-04-13 珠海格力电器股份有限公司 Foreign matter detection method based on millimeter wave sensor and washing machine
CN113136689A (en) * 2020-01-17 2021-07-20 青岛海尔洗衣机有限公司 Paper foreign matter detection method for washing machine
CN111501280A (en) * 2020-04-22 2020-08-07 青岛海尔洗衣机有限公司 Control method of clothes treatment equipment and clothes treatment equipment
CN113622144B (en) * 2020-05-07 2023-11-07 云米互联科技(广东)有限公司 Laundry control method, laundry control system, washing machine and computer readable storage medium
CN111850946A (en) * 2020-07-17 2020-10-30 珠海格力电器股份有限公司 Control method and device of washing machine
CN112150774B (en) * 2020-09-18 2022-10-21 海尔优家智能科技(北京)有限公司 Washing machine abnormity detection processing method and device
CN113774627B (en) * 2021-08-30 2022-08-12 珠海格力电器股份有限公司 Washing machine control method, device, equipment and storage medium
CN113914054A (en) * 2021-10-29 2022-01-11 无锡飞翎电子有限公司 Sterilizing method, sterilizing device, clothes treating apparatus, and computer-readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102305797A (en) * 2011-04-29 2012-01-04 无锡众望四维科技有限公司 Method for automatically detecting foreign matter of medical product package by using machine vision system
CN104730930A (en) * 2015-01-16 2015-06-24 小米科技有限责任公司 Clothes sorting method and device and clothes washing method and device
CN105420987A (en) * 2014-08-21 2016-03-23 宇龙计算机通信科技(深圳)有限公司 Method for controlling clothes washing and washing machine
CN106884278A (en) * 2017-04-17 2017-06-23 东华大学 A kind of multifunctional intellectual laundry care machine
CN107545569A (en) * 2017-08-23 2018-01-05 北京小米移动软件有限公司 Method for recognizing impurities and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102305797A (en) * 2011-04-29 2012-01-04 无锡众望四维科技有限公司 Method for automatically detecting foreign matter of medical product package by using machine vision system
CN105420987A (en) * 2014-08-21 2016-03-23 宇龙计算机通信科技(深圳)有限公司 Method for controlling clothes washing and washing machine
CN104730930A (en) * 2015-01-16 2015-06-24 小米科技有限责任公司 Clothes sorting method and device and clothes washing method and device
CN106884278A (en) * 2017-04-17 2017-06-23 东华大学 A kind of multifunctional intellectual laundry care machine
CN107545569A (en) * 2017-08-23 2018-01-05 北京小米移动软件有限公司 Method for recognizing impurities and device

Also Published As

Publication number Publication date
CN107447442A (en) 2017-12-08

Similar Documents

Publication Publication Date Title
CN107447442B (en) Alarm method based on image recognition technology and intelligent device
CN107653625B (en) Intelligent detection method and intelligent equipment
CN108411565B (en) Washing machine control method and device
US10655261B2 (en) Intelligent laundry device and method therefor
CN109023836B (en) Washing device control method and system and washing machine
CN106149287B (en) Intelligent clothes washing method and device
CN109112774B (en) Control method and device of washing machine, storage medium and washing machine
CN106448090A (en) Information notifying method and device
CN111041771A (en) Washing machine, self-adaptive washing method based on clothes dirt information and terminal
WO2017185728A1 (en) Method and device for identifying key operation
CN106406694A (en) Cleaning method of mobile terminal and mobile terminal
CN110974104B (en) Dish washing machine water supplementing control method and device, storage medium and dish washing machine
US20230124027A1 (en) Systems and methods for capturing images for use in artificial intelligence processes in a laundry appliance
WO2022033279A1 (en) Method and device for determining wash cycle, and washing machine
CN109763547A (en) Control method, device and the garbage disposer of garbage disposer
CN105653174A (en) Touch terminal screen capture method and system
CN113862956A (en) Washing machine and water level control method
CN114000303A (en) Control method and device of washing machine, storage medium and washing machine
WO2020054475A1 (en) Washing machine and electronic apparatus connected thereto
CN108729115B (en) Control method and device for machine door
EP4040737A1 (en) Method and device for controlling laundry equipment, and storage medium
CN110318213B (en) Cleaning method and related device
CN115247347A (en) Washing machine and control method thereof
CN114263014A (en) Laundry control method and device, electronic equipment and storage medium
CN114622377A (en) Control method, device and equipment of clothes treatment equipment and intelligent gateway

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant