CN114507968A - Washing machine clothes detection method, device, equipment and storage medium - Google Patents

Washing machine clothes detection method, device, equipment and storage medium Download PDF

Info

Publication number
CN114507968A
CN114507968A CN202011280789.2A CN202011280789A CN114507968A CN 114507968 A CN114507968 A CN 114507968A CN 202011280789 A CN202011280789 A CN 202011280789A CN 114507968 A CN114507968 A CN 114507968A
Authority
CN
China
Prior art keywords
clothes
washing machine
inner drum
image information
washed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011280789.2A
Other languages
Chinese (zh)
Inventor
石代兴
孙蓓蓓
刘琳
黄振兴
许升
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Haier Washing Machine Co Ltd
Haier Smart Home Co Ltd
Original Assignee
Qingdao Haier Washing Machine Co Ltd
Haier Smart Home Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Haier Washing Machine Co Ltd, Haier Smart Home Co Ltd filed Critical Qingdao Haier Washing Machine Co Ltd
Priority to CN202011280789.2A priority Critical patent/CN114507968A/en
Publication of CN114507968A publication Critical patent/CN114507968A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • DTEXTILES; PAPER
    • D06TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
    • D06FLAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
    • D06F33/00Control of operations performed in washing machines or washer-dryers 
    • D06F33/30Control of washing machines characterised by the purpose or target of the control 
    • D06F33/32Control of operational steps, e.g. optimisation or improvement of operational steps depending on the condition of the laundry
    • DTEXTILES; PAPER
    • D06TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
    • D06FLAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
    • D06F34/00Details of control systems for washing machines, washer-dryers or laundry dryers
    • D06F34/04Signal transfer or data transmission arrangements
    • DTEXTILES; PAPER
    • D06TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
    • D06FLAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
    • D06F34/00Details of control systems for washing machines, washer-dryers or laundry dryers
    • D06F34/14Arrangements for detecting or measuring specific parameters
    • D06F34/18Condition of the laundry, e.g. nature or weight
    • DTEXTILES; PAPER
    • D06TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
    • D06FLAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
    • D06F2103/00Parameters monitored or detected for the control of domestic laundry washing machines, washer-dryers or laundry dryers
    • D06F2103/02Characteristics of laundry or load
    • DTEXTILES; PAPER
    • D06TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
    • D06FLAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
    • D06F2103/00Parameters monitored or detected for the control of domestic laundry washing machines, washer-dryers or laundry dryers
    • D06F2103/02Characteristics of laundry or load
    • D06F2103/04Quantity, e.g. weight or variation of weight
    • DTEXTILES; PAPER
    • D06TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
    • D06FLAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
    • D06F2103/00Parameters monitored or detected for the control of domestic laundry washing machines, washer-dryers or laundry dryers
    • D06F2103/02Characteristics of laundry or load
    • D06F2103/06Type or material
    • DTEXTILES; PAPER
    • D06TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
    • D06FLAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
    • D06F2105/00Systems or parameters controlled or affected by the control systems of washing machines, washer-dryers or laundry dryers
    • D06F2105/46Drum speed; Actuation of motors, e.g. starting or interrupting

Abstract

The invention belongs to the technical field of intelligent washing machines, and particularly relates to a washing machine clothes detection method, device, equipment and storage medium. The invention aims to solve the problem that the existing clothes detection result is inaccurate. According to the embodiment of the invention, first image information is obtained by carrying out image acquisition on clothes to be washed in an inner drum of a washing machine; controlling the inner drum of the washing machine to rotate according to the first image information so as to adjust the position of the clothes to be washed in the inner drum of the washing machine; and acquiring an image of the clothes to be washed in the rotating inner drum of the washing machine to obtain second image information, and detecting the clothes according to the second image information. The condition of the clothes in the inner drum of the washing machine is analyzed through the first image information, the inner drum of the washing machine is controlled to rotate, so that second image information capable of better representing the characteristics of the clothes is obtained, the clothes are detected according to the second image information, the recognition rate of the clothes in the washing machine can be improved, and the recognition effect is improved.

Description

Washing machine clothes detection method, device, equipment and storage medium
Technical Field
The invention belongs to the technical field of intelligent household appliances, and particularly relates to a washing machine clothes detection method, a washing machine clothes detection device, washing machine clothes detection equipment and a storage medium.
Background
Along with the popularization of intelligent household electrical appliances, more and more users begin to use the intelligent household electrical appliances, and through the iteration and the upgrade of the functions of the products, the functions of the intelligent household electrical appliances are more and more perfect. At present, in order to realize a fully-automatic washing operation flow, before a washing machine starts a washing operation, clothes to be washed put into an inner drum of the washing machine need to be detected so as to determine the safety of an operation environment and match a proper washing program.
However, when the number of the clothes to be washed in the intelligent washing machine is large, the problem of inaccurate clothes detection result is caused, so that the matching of the washing program is wrong, the washing effect is influenced, and even the problem of use safety is caused.
Accordingly, there is a need in the art for a new laundry machine laundry detection method, apparatus, device and storage medium to solve the above problems.
Disclosure of Invention
In order to solve the above problems in the prior art, that is, to solve the problem of inaccurate clothes detection results of the existing washing machine, the invention provides a clothes detection method, a clothes detection device, clothes detection equipment and a storage medium for a washing machine.
According to a first aspect of embodiments of the present invention, there is provided a laundry detection method of a washing machine, including: acquiring an image of clothes to be washed in an inner drum of a washing machine to obtain first image information; controlling the inner drum of the washing machine to rotate according to the first image information so as to adjust the position of the clothes to be washed in the inner drum of the washing machine; and acquiring an image of the clothes to be washed in the rotating inner drum of the washing machine to obtain second image information, and detecting the clothes according to the second image information.
In a preferred embodiment of the above method for detecting laundry in a washing machine, the method for controlling rotation of an inner tub of a washing machine according to the first image information includes: determining shielding information of the clothes to be washed according to the first image information, wherein the shielding information is used for representing shielding degrees among the clothes to be washed; determining the rotation program of the inner drum of the washing machine according to the shielding information; and controlling the inner drum of the washing machine to rotate according to the rotation program of the inner drum of the washing machine.
In a preferred embodiment of the above method for detecting laundry in a washing machine, the washing machine inner drum rotation program is used to control at least one of: inner cylinder rotation speed and inner cylinder rotation angle.
In a preferred embodiment of the above method for detecting laundry in a washing machine, the method further comprises: acquiring weight information of the clothes to be washed in the inner drum of the washing machine; determining a rotation program of the inner drum of the washing machine according to the shielding information, comprising the following steps: and determining the rotation program of the inner drum of the washing machine according to the shielding information of the clothes to be washed and the weight information of the clothes to be washed.
In a preferred embodiment of the above method for detecting laundry in a washing machine, the detecting laundry according to the second image information includes: and performing image recognition on the second image information, and determining the clothes color and/or the clothes type corresponding to each clothes in the clothes to be washed.
In a preferred embodiment of the above method for detecting laundry in a washing machine, the method further comprises: and starting a corresponding washing program according to the clothes color and/or the clothes type corresponding to each clothes in the clothes to be washed.
In a preferred embodiment of the above method for detecting laundry in a washing machine, the detecting laundry according to the second image information includes: and performing image recognition on the second image information, and determining whether living creatures exist in the inner drum of the washing machine.
According to a second aspect of the embodiments of the present invention, there is provided a laundry detecting apparatus of a washing machine, including:
in an preferable technical solution of the laundry machine clothes detection apparatus, the control module is specifically configured to: determining shielding information of the clothes to be washed according to the first image information, wherein the shielding information is used for representing shielding degrees among the clothes to be washed; determining the rotation program of the inner drum of the washing machine according to the shielding information; and controlling the inner drum of the washing machine to rotate according to the rotation program of the inner drum of the washing machine.
In a preferred embodiment of the above laundry machine clothing detecting device, the washing machine inner drum rotation program is used for controlling at least one of the following: inner cylinder rotation speed and inner cylinder rotation angle.
In a preferred technical solution of the above laundry machine clothes detection apparatus, the laundry machine clothes detection apparatus further includes a weight collection module for: acquiring weight information of the clothes to be washed in the inner drum of the washing machine; determining a rotation program of the inner drum of the washing machine according to the shielding information, comprising the following steps: and determining the rotation program of the inner drum of the washing machine according to the shielding information of the clothes to be washed and the weight information of the clothes to be washed.
In a preferred technical solution of the laundry machine clothes detection device, the detection module is specifically configured to: and performing image recognition on the second image information, and determining the clothes color and/or the clothes type corresponding to each piece of clothes in the clothes to be washed.
In a preferred embodiment of the laundry machine clothing detecting device, the control module is further configured to: and starting a corresponding washing program according to the clothes color and/or the clothes type corresponding to each clothes in the clothes to be washed.
In a preferred technical solution of the laundry machine clothes detection apparatus, the detection module is further configured to: and performing image recognition on the second image information, and determining whether living creatures exist in the inner drum of the washing machine.
According to a third aspect of embodiments of the present invention, there is provided an electronic apparatus including: a memory, a processor, and a computer program;
wherein the computer program is stored in the memory and configured to be executed by the processor to perform the laundry machine laundry detection method according to any one of the first aspect of the embodiments of the present invention.
According to a fourth aspect of the embodiments of the present invention, there is provided a computer-readable storage medium having stored therein computer-executable instructions for implementing the laundry machine laundry detection method according to any one of the first aspect of the embodiments of the present invention when the computer-executable instructions are executed by a processor.
The person skilled in the art can understand that the method, the device, the equipment and the storage medium for detecting the clothes of the washing machine of the invention acquire the first image information by acquiring the image of the clothes to be washed in the inner drum of the washing machine; controlling the inner drum of the washing machine to rotate according to the first image information so as to adjust the position of the clothes to be washed in the inner drum of the washing machine; and acquiring an image of the clothes to be washed in the rotating inner drum of the washing machine to obtain second image information, and detecting the clothes according to the second image information. Before detecting the clothes in the washing machine, the clothes condition in the inner drum of the washing machine is analyzed through the pre-collected first image information, the inner drum of the washing machine is controlled to rotate, the position of the clothes in the washing machine is adjusted, second image information capable of better representing the characteristics of the clothes is obtained, the clothes are detected according to the second image information, the recognition rate of the clothes in the washing machine can be improved, the recognition effect is improved, the safety effect of the washing machine can be better guaranteed, and the washing program can be accurately matched.
Drawings
Preferred embodiments of a laundry machine laundry detection method, apparatus and device of the present invention are described below with reference to the accompanying drawings. The attached drawings are as follows:
fig. 1 is a view of an application scenario of a laundry detection method for a washing machine according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method for detecting laundry in a washing machine according to an embodiment of the present invention;
fig. 3 is a schematic view illustrating a process of collecting an image of laundry according to an embodiment of the present invention;
FIG. 4 is a flow chart of a laundry detection method of a washing machine according to another embodiment of the present invention;
FIG. 5 is a schematic structural diagram of a laundry detection device of a washing machine according to an embodiment of the present invention;
FIG. 6 is a schematic structural diagram of a laundry detection device of a washing machine according to another embodiment of the present invention;
fig. 7 is a schematic diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
First, it should be understood by those skilled in the art that these embodiments are merely for explaining the technical principles of the present invention, and are not intended to limit the scope of the present invention. And can be adjusted as needed by those skilled in the art to suit particular applications.
Furthermore, it should be noted that, in the description of the present invention, unless otherwise explicitly specified or limited, the terms "connected" and "connected" should be interpreted broadly, e.g., as being fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; the two components can be directly connected or indirectly connected through an intermediate medium, and the two components can be communicated with each other. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
The terms to which the present invention relates will be explained first:
1) the intelligent household appliance equipment is a household appliance product formed by introducing a microprocessor, a sensor technology and a network communication technology into the household appliance equipment, has the characteristics of intelligent control, intelligent perception and intelligent application, and the operation process of the intelligent household appliance equipment usually depends on the application and processing of modern technologies such as the Internet of things, the Internet and an electronic chip, for example, the intelligent household appliance equipment can realize the remote control and management of a user on the intelligent household appliance equipment by connecting the intelligent household appliance equipment with the electronic equipment.
2) Terminal equipment indicates the electronic equipment who has wireless connection function, and terminal equipment can carry out communication connection through connecting the internet with intelligent household electrical appliances as above, also can directly carry out communication connection through modes such as bluetooth, wifi with intelligent household electrical appliances as above. In some embodiments, the terminal device is, for example, a mobile device, a computer, or a vehicle-mounted device built in a floating car, or any combination thereof. The mobile device may include, for example, a cell phone, a smart home device, a wearable device, a smart mobile device, a virtual reality device, or the like, or any combination thereof, wherein the wearable device includes, for example: smart watches, smart bracelets, pedometers, and the like.
3) "plurality" means two or more, and other terms are analogous. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
4) "correspond" may refer to an association or binding relationship, and a corresponds to B refers to an association or binding relationship between a and B.
The following explains an application scenario of the embodiment of the present invention:
fig. 1 is an application scenario diagram of a laundry detection method for a washing machine according to an embodiment of the present invention, as shown in fig. 1, in the application scenario, after a user puts laundry into an intelligent washing machine, the user selects and starts an "automatic washing" function of the intelligent washing machine to perform a washing operation. After receiving a starting instruction sent by a user through the face of the washing machine or the terminal device, the intelligent washing machine can detect clothes and match the optimal washing program to carry out washing operation according to the detection result.
In the related art, in order to improve the washing quality of the clothes while realizing the full-automatic washing operation, the intelligent washing machine needs to detect the clothes and distinguish different types and colors of clothes so as to match the optimal washing program. However, when the number of laundry loaded into the washing machine is large, different laundry may be blocked, and it is difficult to accurately identify all the laundry by capturing images of the laundry through a camera disposed outside the drum. Therefore, the conventional method for detecting the clothes in the tub by image recognition can only realize full-automatic washing operation matched with the clothes detection and washing program of one or two pieces of clothes to be washed.
Therefore, for the reasons mentioned above, after the intelligent washing machine in the prior art detects the clothes through the image recognition technology, the intelligent washing machine usually configures the washing parameters such as the amount of water, the amount of detergent, and the washing duration required for washing the clothes according to the detection result, and determines the corresponding washing program according to such washing parameters. Since such laundry parameters do not require accurate determination of information on the type, color, and the like of each piece of clothes, they can be determined only by recognizing the general type, volume, and number of the clothes. However, for more accurate washing procedures, such as a "sweater washing" procedure for washing sweater exclusively, and an "underwear washing" procedure for washing underwear exclusively, more accurate detection of the clothes is required. For example, in one particular exemplary scenario, a user puts into laundry in a washing machine, inadvertently mixes a piece of sweater, and must wash using a "sweater washing" program because the sweater cannot use a conventional washing program, or otherwise causes the sweater to be damaged. Under the circumstance, in the prior art, the method for detecting the clothes through the image recognition technology cannot accurately recognize the type of each piece of clothes, so that the washing machine cannot be guaranteed to be matched with a correct washing program of 'sweater washing', and the sweater mixed in the clothes to be washed is damaged in the washing process. Therefore, a more accurate clothes detection method is needed at present, which can accurately detect a plurality of clothes to be washed, so as to realize accurate matching of special washing procedures such as "sweater washing" and "underwear washing", and improve the washing effect of the clothes.
The following describes the technical solution of the present invention and how to solve the above technical problems with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present invention will be described below with reference to the accompanying drawings.
Fig. 2 is a flowchart of a laundry detection method for a washing machine according to an embodiment of the present invention, which is applied to an intelligent washing machine, and as shown in fig. 2, the laundry detection method for a washing machine according to the embodiment includes the following steps:
step S101, image acquisition is carried out on clothes to be washed in an inner drum of the washing machine, and first image information is obtained.
Illustratively, taking a drum washing machine as an example, an intelligent washing machine is provided with a drum for containing and washing laundry, i.e. a washing machine inner drum, and a controller of the intelligent washing machine can control the washing machine inner drum to rotate, so as to realize the operation processes of washing, dewatering and the like on the laundry in the washing machine inner drum. In a possible implementation manner, an image acquisition unit, such as a camera, is arranged in the intelligent washing machine, and the camera faces the inner side of the inner drum of the washing machine so as to acquire an image of clothes to be washed in the inner drum of the washing machine.
Specifically, the timing of image acquisition of the laundry in the inner drum of the washing machine may be that the intelligent washing machine receives an instruction, which is input by a user and instructs the intelligent washing machine to perform a washing operation, before the washing operation is performed, or before the intelligent washing machine performs the washing operation according to a preset washing plan, which is not specifically limited herein. The method comprises the steps of carrying out image acquisition on the clothes to be washed in the inner drum of the washing machine, and using obtained first image information to represent the characteristics of the clothes to be washed in the inner drum of the washing machine, such as pictures or videos. Optionally, the number of times of image acquisition of the intelligent washing machine on the laundry in the inner drum of the washing machine may be one time or multiple times.
And S102, controlling the inner drum of the washing machine to rotate according to the first image information so as to adjust the position of the clothes to be washed in the inner drum of the washing machine.
Further, the first image information may be used to express the appearance feature and the position feature of the laundry. Taking the first image information as an example of a shot picture of the laundry in the tub, by performing image recognition on the first image information, it can be determined whether occlusion exists between the laundry in the laundry, and if an occlusion state exists between the laundry in the laundry, the inner tub of the washing machine is controlled to rotate, so that positions of the laundry are changed. In one possible implementation, the shielding state between the clothes may refer to a position where a certain clothes cannot be located. For example, according to the washing parameters input by the user, the total number of the clothes to be washed can be determined to be 5, but after image recognition is carried out through the collected first image information, only 4 pieces of clothes are located, and the clothes are determined to be in a shielding state. In another possible implementation, the blocking state between the clothes refers to the position where the clothes can be located, but the type of the clothes cannot be identified. The above two shielding state implementation manners may be used alone or together as a condition for determining whether the clothes are in the shielding state, and are not described herein again.
And step S103, carrying out image acquisition on the clothes to be washed in the inner drum of the rotating washing machine to obtain second image information, and carrying out clothes detection according to the second image information.
Fig. 3 is a schematic diagram of a process of collecting an image of laundry according to an embodiment of the present invention, and referring to fig. 3, after determining that the laundry is in a blocking state, controlling an inner drum of a washing machine to rotate so as to change positions of the laundry, and while or after the inner drum of the washing machine rotates, collecting an image of the laundry in the inner drum of the washing machine again to obtain second image information, where the second image information is, for example, a picture collected by a camera in the inner drum of the washing machine; determining whether the clothes are still in the shielding state, if the clothes are not in the shielding state, directly determining the type of the clothes according to the second image information, and completing the detection of the clothes; if the clothes are in a shielding state, continuously controlling the inner drum of the washing machine to rotate, and obtaining second image information; in the continuous rotation process, the appearance characteristics of new clothes are provided in the second image information acquired every time, the appearance characteristics of the clothes are extracted and fused through the continuous acquisition of the second image information, and the type information of all the clothes to be washed is gradually identified, namely, the clothes are in a non-shielding state. It should be noted that the non-shielding state referred to herein does not mean that the clothes in the laundry are completely separated in physical space, but means that the clothes are in a recognizable state by collecting one or more pieces of second image information and utilizing superposition of appearance features of the clothes at various angles, and finally, accurate detection of the clothes in the laundry is achieved.
In the embodiment, first image information is obtained by carrying out image acquisition on clothes to be washed in an inner barrel of the washing machine; controlling the inner drum of the washing machine to rotate according to the first image information so as to adjust the position of the clothes to be washed in the inner drum of the washing machine; and acquiring an image of the clothes to be washed in the rotating inner drum of the washing machine to obtain second image information, and detecting the clothes according to the second image information. Before detecting the clothes in the washing machine, the clothes condition in the inner drum of the washing machine is analyzed through the pre-collected first image information, the inner drum of the washing machine is controlled to rotate, the position of the clothes in the washing machine is adjusted, second image information capable of better representing the characteristics of the clothes is obtained, the clothes are detected according to the second image information, the recognition rate of the clothes in the washing machine can be improved, the recognition effect is improved, the safety effect of the washing machine can be better guaranteed, and the washing program can be accurately matched.
Fig. 4 is a flowchart of a laundry detection method of a washing machine according to another embodiment of the present invention, as shown in fig. 4, the laundry detection method of the washing machine according to the present embodiment further details steps S102-S103 on the basis of the laundry detection method of the washing machine according to the embodiment shown in fig. 2, and then the laundry detection method of the washing machine according to the present embodiment includes the following steps:
step S201, image acquisition is carried out on the clothes to be washed in the inner drum of the washing machine, and first image information is obtained.
Step S202, according to the first image information, determining shielding information of the clothes to be washed, wherein the shielding information is used for representing shielding degrees among the clothes to be washed.
Illustratively, the occlusion information is information describing an occlusion state between the clothes, and the occlusion information includes, for example, an occlusion coefficient, and the higher the occlusion coefficient is, the greater the occlusion degree between the clothes is, that is, the clothes to be washed are difficult to identify; correspondingly, the smaller the shielding coefficient, the smaller the shielding degree between the clothes is, i.e. the clothes to be washed is easier to identify. Further, the occlusion coefficient may be determined by the result of image recognition, for example, the occlusion coefficient is smaller when the recognition result confidence of a certain target object in the first image information is higher, and conversely, the occlusion coefficient is larger when the recognition result confidence of a certain target object in the first image information is lower.
And step S203, determining the rotation program of the inner drum of the washing machine according to the shielding information.
And step S204, controlling the rotation of the inner barrel of the washing machine according to the rotation program of the inner barrel of the washing machine.
Specifically, the shielding information is used for representing the shielding degree information among the clothes, and when the shielding degree among the clothes is large, the shielding information corresponds to the situation in a real scene, namely the clothes in the inner drum of the washing machine are interwoven together, and the clothes which are seriously interwoven together cannot be separated by simply controlling the inner drum to rotate by a certain angle, so that the clothes are identified. Therefore, when the shielding degree between the clothes is large, that is, the clothes are seriously interlaced, the inner drum of the washing machine needs to be rotated at a high speed or at a variable speed to separate the interlaced clothes, so that more appearance features of the clothes are exposed, and the recognition speed and the recognition accuracy of the clothes are improved.
Further, the washing machine drum rotation program is illustratively used to control drum rotation speed, and/or drum rotation angle. Specifically, according to the shielding information, the intelligent washing machine determines a corresponding washing machine inner barrel rotation program, so that the washing machine inner barrel rotates at different angles at different rotation speeds. In a more specific embodiment, the shielding coefficient in the shielding information has a preset mapping relation with the washing machine drum rotation program. For example, when the shielding coefficient is 0.2, determining a washing machine inner barrel rotation program A according to a preset mapping table, and controlling the washing machine inner barrel to rotate 90 degrees at the speed of 0.3 r/s; and when the shielding coefficient is 0.8, determining a washing machine inner barrel rotation program B according to a preset mapping table, controlling the washing machine inner barrel to rotate for 90 degrees at the speed of 3 revolutions per second, then stopping for 0.5 second, and repeating the process for 5 times. The mapping relation between the different washing machine inner cylinder rotation programs and the shielding information is related to different inner cylinder structures, the mapping relation can be preset when the intelligent washing machine leaves a factory, and can also be set by a user according to needs, and the mapping relation is not described in detail here.
In the embodiment, the corresponding rotation program of the inner drum of the washing machine is determined according to the shielding information, and the inner drum of the washing machine is controlled to rotate at the inner drum rotation angle and the inner drum rotation speed which are matched, so that the appearance characteristics of the clothes can be better exposed by the rotation of the inner drum, and the clothes detection efficiency and the clothes detection accuracy are improved.
In one possible implementation, determining a washing machine drum rotation program further includes:
acquiring weight information of clothes to be washed in an inner drum of the washing machine; and determining the rotation program of the inner drum of the washing machine according to the shielding information of the clothes to be washed and the weight information of the clothes to be washed.
Illustratively, the purpose of the rotation of the inner drum of the washing machine is to change the position of the clothes in the inner drum of the washing machine, so as to better collect image information and identify the type of the clothes, and when the number of the clothes in the inner drum is large, the shielding situation between the clothes is more complicated, so that, in order to better identify the type of each clothes, the quantity of the clothes is judged by collecting the weight information of the clothes to be washed, and when the weight of the clothes to be washed is large, the inner drum of the washing machine can be rotated fully by using a larger rotating speed and a larger rotating angle, so that the position between the clothes can be changed obviously, so that the appearance characteristics of the clothes are more exposed, and the collected second image information can include more appearance characteristics of the clothes, thereby improving the speed and the accuracy of clothes identification.
In the embodiment, by acquiring the weight information of the clothes to be washed and determining the rotation program of the inner drum of the washing machine according to the shielding information of the clothes to be washed and the weight information of the clothes to be washed, the rotation program of the inner drum of the washing machine can be matched with the proper weight of the clothes, so that the inner drum of the washing machine can rotate more fully, the number of the effective appearance characteristics of the clothes collected in the second image information is increased, the times of collecting the second image information is reduced, and the effect of improving the clothes detection efficiency is realized.
Step S205, collecting an image of the laundry in the inner drum of the rotating washing machine to obtain second image information, performing image recognition on the second image information, and determining a color and/or a type of the laundry corresponding to each laundry in the laundry.
In particular, in the rotating inner drum of the washing machine, the position of the clothes to be washed is changed, so that the appearance characteristics of the clothes which cannot be obtained when the clothes are in a shielding state can be obtained through the collected second image information. Further, by performing image recognition using the second image information, recognition of the laundry, specifically, including recognition of the color of the laundry and the type of the laundry, may be achieved.
Step S206, according to the corresponding clothes color and/or clothes type of each clothes in the clothes to be washed, starting the corresponding washing program.
In particular, the intelligent washing machine is provided with special washing programs designed for specific clothes types and clothes colors. For example, "sweater washing" procedures, which are specialized for washing sweaters, preventing deformation and shrinkage of the sweater; as another example, a "colored laundry washing" program that specializes in users washing laundry that is prone to color fading. The program of 'sweater washing' needs to be called after the type of clothes is determined; the program of "washing colored clothes" needs to be called after the color of the clothes is determined.
In the embodiment, the clothes are identified, the clothes type and the clothes color are determined, and the accurate matching of the special washing program can be realized. Since the special laundry program is usually specific to a specific laundry scene and a specific type of clothes, such as the "sweater washing" program and the "colored laundry washing" program in the above examples, if the type of clothes and the color of clothes of each piece of clothes to be washed cannot be accurately detected, the clothes are detected by the conventional image detection technology in the prior art, if one piece of sweater is missed and the "sweater washing" program is not used, the damage to the piece of sweater is caused, and if one piece of colored clothes is missed and the "colored laundry washing" program is not used, all pieces of clothes are dyed. Therefore, in the embodiment, the technical characteristic that the first image information controls the rotation of the inner drum of the washing machine is matched with the acquisition of the second image information to perform image recognition, so that the types and colors of the clothes are obtained, and a special washing program is determined to perform clothes washing according to the image recognition, so that the real full-automatic washing operation is realized, the problem that a user needs to perform a process of screening the clothes to be washed manually in the front due to the fact that each piece of clothes cannot be detected accurately is avoided, and the washing efficiency and the washing effect are improved.
And step S207, performing image recognition on the second image information, and determining whether living creatures exist in the inner drum of the washing machine.
Specifically, as a common household appliance, in a household with pets and infants, if living organisms such as pets or infants enter an inner barrel of the washing machine, the washing machine starts water injection and washing operations, and then the living organisms are greatly damaged, which causes safety accidents. Therefore, before the washing machine executes the washing program to perform operation, the intelligent washing machine performs image recognition according to the second image information, and detection of living organisms hidden in the clothes to be washed can be achieved. In some special scenes, for example, in an indoor environment with low air temperature, living creatures such as pets and the like enter clothes in an inner drum of the washing machine for the purpose of warming and rest, so that in the scene, the conventional clothes detection method based on image detection is static to acquire images, and the living creatures hidden under the clothes are difficult to find, so that the detection omission of the living creatures is caused. In the embodiment, since the inner drum of the washing machine is rotated by the first image information in the above steps, the living creatures hidden in the clothes can be warned to move out of the clothes, so that the living creatures hidden in the clothes can be better found, and the detection effect of the living creatures is improved.
In this embodiment, the implementation manner of step S201 is the same as the implementation manner of step S101 in the embodiment shown in fig. 2 of the present invention, and is not described in detail here.
Fig. 5 is a schematic structural diagram of a laundry detection device for a washing machine according to an embodiment of the present invention, which is applied to an intelligent washing machine, and as shown in fig. 5, a laundry detection device 3 for a washing machine according to the embodiment includes:
the image acquisition module 31 is configured to acquire an image of laundry in an inner tub of the washing machine to obtain first image information.
And the control module 32 is used for controlling the washing machine inner drum to rotate according to the first image information so as to adjust the position of the clothes to be washed in the washing machine inner drum.
The image collecting module 31 is further configured to collect an image of the laundry in the inner drum of the washing machine after rotation, so as to obtain second image information.
And a detection module 33, configured to perform laundry detection according to the second image information.
The image acquisition module 31, the control module 32 and the detection device 33 are connected in sequence. The laundry detection device 3 of the washing machine provided in this embodiment can implement the technical solution of the method embodiment shown in fig. 2, and the implementation principle and technical effect are similar, and are not described herein again.
Fig. 6 is a schematic structural diagram of a laundry detection device of a washing machine according to another embodiment of the present invention, where the laundry detection device 4 of the washing machine provided in this embodiment is added with a weight collection module 41 on the basis of the laundry detection device of the washing machine shown in fig. 5, as shown in fig. 6:
in one possible implementation, the control module 32 is specifically configured to: determining shielding information of the clothes to be washed according to the first image information, wherein the shielding information is used for representing the shielding degree among the clothes to be washed; determining the rotation program of the inner drum of the washing machine according to the shielding information; and controlling the rotation of the inner barrel of the washing machine according to the rotation program of the inner barrel of the washing machine.
In one possible implementation, the washing machine drum rotation program is used to control at least one of: inner cylinder rotation speed and inner cylinder rotation angle.
In a possible implementation, the laundry machine laundry detection device 4 further comprises a weight acquisition module 41 for: acquiring weight information of clothes to be washed in an inner drum of the washing machine; according to the shielding information, determining the rotation program of the inner drum of the washing machine, comprising the following steps: and determining the rotation program of the inner drum of the washing machine according to the shielding information of the clothes to be washed and the weight information of the clothes to be washed.
In a possible implementation manner, the detection module 33 is specifically configured to: and performing image recognition on the second image information, and determining the clothes color and/or the clothes type corresponding to each clothes in the clothes to be washed.
In one possible implementation, the control module 32 is further configured to: and starting the corresponding washing program according to the corresponding clothes color and/or clothes type of each clothes in the clothes to be washed.
In a possible implementation manner, the detection module 33 is further configured to: and performing image recognition on the second image information to determine whether living creatures exist in the inner drum of the washing machine.
The image acquisition module 31, the control module 32 and the detection device 33 are connected in sequence. The laundry detection device 3 of the washing machine provided in this embodiment can implement the technical solution of the method embodiment shown in fig. 2, and the implementation principle and technical effect are similar, and are not described herein again.
Wherein, the weight collecting module 41 is connected with the control module 32. The laundry detection apparatus 4 of the washing machine provided in this embodiment may implement the technical solutions of the method embodiments shown in fig. 2 to fig. 4, and the implementation principles and technical effects are similar, which are not described herein again.
Fig. 7 is a schematic diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 7, the electronic device according to the embodiment includes: a memory 51, a processor 52 and a computer program.
Wherein the computer program is stored in the memory 51 and configured to be executed by the processor 52 to implement the laundry detection method of the washing machine provided by any one of the embodiments corresponding to fig. 2-4 of the present invention.
The memory 51 and the processor 52 are connected by a bus 53.
The relevant description may be understood by referring to the relevant description and effect corresponding to the steps in the embodiments corresponding to fig. 2 to fig. 4, and redundant description is not repeated here.
An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, the computer program being executed by a processor to implement the laundry detection method of the washing machine provided in any one of the embodiments corresponding to fig. 2 to 4 of the present invention.
The computer readable storage medium may be, among others, ROM, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of modules is merely a division of logical functions, and an actual implementation may have another division, for example, a plurality of modules or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
So far, the technical solutions of the present invention have been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of the present invention is obviously not limited to these specific embodiments. Equivalent changes or substitutions of related technical features can be made by those skilled in the art without departing from the principle of the invention, and the technical scheme after the changes or substitutions can fall into the protection scope of the invention.

Claims (10)

1. A laundry detection method of a washing machine, characterized in that the method comprises:
acquiring an image of clothes to be washed in an inner drum of a washing machine to obtain first image information;
controlling the inner drum of the washing machine to rotate according to the first image information so as to adjust the position of the clothes to be washed in the inner drum of the washing machine;
and acquiring an image of the clothes to be washed in the rotating inner drum of the washing machine to obtain second image information, and detecting the clothes according to the second image information.
2. The method of claim 1, wherein controlling the washing machine drum to rotate according to the first image information comprises:
determining shielding information of the clothes to be washed according to the first image information, wherein the shielding information is used for representing shielding degrees among the clothes to be washed;
determining the rotation program of the inner drum of the washing machine according to the shielding information;
and controlling the inner drum of the washing machine to rotate according to the rotation program of the inner drum of the washing machine.
3. The method of claim 2, wherein the washing machine drum rotation program is used to control at least one of:
inner cylinder rotation speed and inner cylinder rotation angle.
4. The method of claim 2, further comprising:
acquiring weight information of the clothes to be washed in the inner drum of the washing machine;
determining a rotation program of the inner drum of the washing machine according to the shielding information, comprising the following steps:
and determining the rotation program of the inner drum of the washing machine according to the shielding information of the clothes to be washed and the weight information of the clothes to be washed.
5. The method according to any one of claims 1 to 4, wherein the detecting of the laundry according to the second image information comprises:
and performing image recognition on the second image information, and determining the clothes color and/or the clothes type corresponding to each clothes in the clothes to be washed.
6. The method of claim 5, further comprising:
and starting a corresponding washing program according to the clothes color and/or the clothes type corresponding to each clothes in the clothes to be washed.
7. The method according to any one of claims 1 to 4, wherein the detecting of the laundry according to the second image information comprises:
and performing image recognition on the second image information, and determining whether living creatures exist in the inner drum of the washing machine.
8. A laundry machine laundry detection apparatus, characterized in that the apparatus comprises:
the image acquisition module is used for acquiring images of clothes to be washed in the inner drum of the washing machine to obtain first image information;
the control module is used for controlling the inner drum of the washing machine to rotate according to the first image information so as to adjust the position of the clothes to be washed in the inner drum of the washing machine;
the image acquisition module is also used for acquiring images of the clothes to be washed in the rotating inner drum of the washing machine to obtain second image information;
and the detection device is used for detecting clothes according to the second image information.
9. An electronic device, comprising: a memory, a processor, and a computer program;
wherein the computer program is stored in the memory and configured to be executed by the processor to implement a washing machine laundry detection method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored therein computer-executable instructions for implementing the laundry machine laundry detection method according to any one of claims 1 to 7 when executed by a processor.
CN202011280789.2A 2020-11-16 2020-11-16 Washing machine clothes detection method, device, equipment and storage medium Pending CN114507968A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011280789.2A CN114507968A (en) 2020-11-16 2020-11-16 Washing machine clothes detection method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011280789.2A CN114507968A (en) 2020-11-16 2020-11-16 Washing machine clothes detection method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114507968A true CN114507968A (en) 2022-05-17

Family

ID=81547072

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011280789.2A Pending CN114507968A (en) 2020-11-16 2020-11-16 Washing machine clothes detection method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114507968A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI820813B (en) * 2022-07-22 2023-11-01 台灣松下電器股份有限公司 Smart laundry methods and smart laundry equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI820813B (en) * 2022-07-22 2023-11-01 台灣松下電器股份有限公司 Smart laundry methods and smart laundry equipment

Similar Documents

Publication Publication Date Title
CN108411565B (en) Washing machine control method and device
EP3290560A1 (en) Washing machine control method and washing machine
CN109137388B (en) Laundry washing method, apparatus and laundry treating apparatus
US11299838B2 (en) Washing machine and cloud server setting function based on object sensing using artificial intelligence, and method for setting function
WO2017004787A1 (en) Intelligent washing machine and control method thereof
CN106567220A (en) Washing machine having cloth material identification function and control method thereof
CN114600167A (en) Adjusting machine settings through multi-channel training of target detection models
ES2954427T3 (en) Procedure and system to prepare and carry out a clothes washing cycle
KR20200019523A (en) Clothing treatment apparatus, electronic device and method for controlling thereof
CN114507968A (en) Washing machine clothes detection method, device, equipment and storage medium
CN105868599A (en) Terminal unlocking method and device and terminal
CN113463327B (en) Clothing display method and device, electronic equipment and computer readable storage medium
CN109137392B (en) Clothes washing method and device and clothes treatment device
CN112115839A (en) Clothes cleaning method and device, storage medium and electronic device
CN106033253A (en) A terminal control method and device
CN109413325A (en) A kind of camera control method and mobile terminal based on flexible screen
CN103489149B (en) Method and a kind of electronic equipment that a kind of image is obtained
CN105887419A (en) Detection method and device for articles to be washed in washing machine
CN112962266B (en) Washing nursing device and method and storage medium
CN112650152B (en) Control method and device of electric equipment, electronic equipment and storage medium
CN110399954A (en) The determination method and device of operation information, storage medium, electronic device
CN112195611B (en) Clothes treatment equipment and control method thereof
US11859329B2 (en) Method and device for controlling laundry equipment, and storage medium
CN114481524A (en) Laundry treating apparatus and control method thereof
CN111850940A (en) Control method of clothes treatment equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination