WO2021025195A1

WO2021025195A1 - Clothing treatment device having camera, and control method therefor

Info

Publication number: WO2021025195A1
Application number: PCT/KR2019/009748
Authority: WO
Inventors: 박윤식
Original assignee: 엘지전자 주식회사
Priority date: 2019-08-05
Filing date: 2019-08-05
Publication date: 2021-02-11

Abstract

The present invention relates to a clothing treatment device and, more particularly, to a clothing treatment device having a camera, and a control method therefor. According to one embodiment of the present invention, provided is a control method for a washing machine, comprising, in order to perform washing or rinsing, a clothes movement step of driving a drum or a pulsator that forms a water stream so that wash water and clothes move in the drum, a step of generating, in the clothes movement step, a time-series image for clothes movement by photographing the inside of the drum through a camera, a step of identifying the current movement state of the clothes through the time-series image, a step of supplying additional water by driving a water supply valve according to the flow state of the clothes, and a step of performing washing or rinsing by driving the drum or pulsator after the supply of additional water.

Description

Clothes handling apparatus with camera and control method thereof

The present invention relates to a laundry treatment plant, and more particularly, to a laundry treatment apparatus having a camera and a control method thereof.

There are many kinds of home appliances that receive and process objects. That is, various kinds of home appliances may be provided according to the object and the method of processing the object.

Home appliances that receive clothes and process clothes may include a washing machine, dryer, and styler (clothing processor or clothes manager). Here, the clothing may include various objects such as bedding, textile dolls, and shoes, as well as clothes worn by the user.

The treatment of clothes may include various treatments such as washing, drying, refreshing, sterilization, etc., and any one clothes treatment device may be provided specialized for a specific treatment process among various treatment processes, and may be provided to perform a plurality of treatment processes. Can be provided.

In the case of a washing machine, it may be provided to perform a washing course in which washing and rinsing are performed using washing water and dewatering is performed. In the case of a dryer, a drying or refreshing course in which drying or refreshing is performed using hot air may be provided.

These laundry treatment apparatuses are provided with various treatment courses according to the type of the object, and may include at least one or more sub-information in each treatment course.

The sub-information includes control conditions such as a driving unit or actuator to perform a processing course.For example, in a washing machine, the RPM of the drum or pulsator, the actual running rate (the total time of the motor on time (the motor on time and the motor off) It can include control conditions, such as the sum of time)), water level (water supply valve), and temperature (heater).

Such a home appliance may be extended to a dishwasher that processes dishes or a cooking device that cooks food through food materials. The dishwasher or food ingredients may also be processed through various treatment courses depending on the object being processed or according to the intention of the user.

In the home appliance including the laundry treatment apparatus, as described above, an optimum treatment course may be provided according to the type of the object or the purpose of the object. However, it is necessary for the user to accurately input the type or purpose of the object to the laundry treatment apparatus. However, in many cases, the user cannot accurately know such information, and even if he knows it, there is a problem that it is difficult to accurately input such various information from the clothing processing apparatus. Accordingly, there may be a case in which the laundry treatment apparatus does not optimally process the object.

Korean Patent Publication No. KR20130044764 (hereinafter referred to as "prior patent 1") discloses a washing machine that detects an object to be washed using a camera, extracts information about an object to be washed, and performs washing using the object information. Through this, even if the user does not accurately recognize the type of the object, the washing machine can provide the optimum processing according to the object. However, according to the washing machine according to the prior patent 1, there is a problem in that it is difficult to accurately recognize the type of the object through the camera, and there is an inconvenience that the user must place the object in front of the camera. In addition, even if the washing machine performs object processing through object information, there is a problem that it is not possible to ensure that the object is optimally processed. This is because such a camera can only extract information about the object before processing the object, but cannot provide whether or not the object is optimally processed during object processing.

Republic of Korea Patent Publication KR20160084698 (hereinafter referred to as "prior patent 2") discloses a washing machine capable of detecting an abnormality by photographing the inside of the washing machine using a camera. A washing machine capable of detecting whether a door is opened or closed, whether laundry is dissipating or foaming, etc. can be detected through a camera, and when such an abnormal situation is detected, through control of a driving unit, is disclosed. However, according to the washing machine according to the prior patent 2, only a method of detecting and coping with an abnormal situation is presented, and it is not possible to determine whether or not the object is being processed optimally. That is, when the object processing is normally performed, it is not an abnormal situation, and thus the control of the driving unit according to the abnormal situation is not followed. Therefore, prior patent 2 fails to provide a method of providing whether or not an object is being processed optimally and a method of controlling the object to be processed optimally.

Therefore, even if the user does not accurately recognize the information on the type of object, the object's treatment purpose, and the object's properties (for example, cloth quality, moisture content, and degree of stiffness), clothing can be optimally processed. There is a need to provide a home appliance including a processing device.

Meanwhile, laundry in a washing machine is effectively performed using detergent, washing water, and friction or impact energy. Friction or impact energy is energy (mechanical force) generated between laundry and drum or between laundry and laundry, and this energy must be effectively generated as the drum rotates.

However, in the washing process, the rotational RPM of the drum is uniformly fixed. Therefore, it is not known whether sufficient mechanical power is supplied to the laundry when the fabric is changed or the fabric amount is changed.

In general, the larger the amount of fabric, the more mechanical power is provided, that is, the washing time increases, or the ratio of the time the drum is driven (actual operation rate) is increased, and it is known whether sufficient and effective mechanical power is supplied to the laundry when the drum is driven. What cannot be done is reality.

Therefore, when washing or rinsing, it is possible to determine whether or not the laundry moves effectively inside the drum, and accordingly, a method for effectively moving the laundry inside the drum can be found.

In particular, in the case of a vertical axis laundry machine (top loader) in which laundry and rinsing are performed because laundry is immersed in laundry water, the amount of laundry absorbed by the laundry varies depending on the fabric. Therefore, there may be a problem that laundry does not effectively flow in the washing water depending on the fabric. In other words, as the drum rotates, washing water and laundry do not sufficiently flow, and only the drum may rotate. In this case, sufficient mechanical power is not provided to the laundry, and the washing and rinsing performance may be significantly deteriorated.

Therefore, there is a need to always ensure sufficient flow of the laundry cloth to effectively perform washing/rinsing in not only the horizontal axis washing apparatus (front loader) but also the vertical axis washing apparatus.

An object of the present invention is to basically solve the problem of home appliances including a conventional clothes treatment apparatus.

According to an embodiment of the present invention, it is possible to determine whether an object is being processed optimally through time series information generated through a camera, and feedback control of a driving unit or an actuator so that the object is optimally processed. It is intended to provide a laundry treatment apparatus and a control method thereof.

According to an embodiment of the present invention, it is intended to provide a laundry treatment apparatus and a control method thereof capable of improving laundry performance and minimizing damage to the fabric by performing an optimal fabric flow during washing or rinsing.

According to an embodiment of the present invention, a clothing processing apparatus capable of providing a current object processing situation to a user through time series images or image information and a control method thereof is provided. In particular, it is intended to provide a laundry treatment apparatus and a control method thereof capable of providing information on the current object handling situation and evaluation information on the same to a user. As an example, it is intended to provide information on the processing situation that the foam dispersion is being performed for the main dehydration entry, evaluation information that the degree of foam dispersion is one of upper and lower, feedback control information to increase the degree of foam dispersion, and evaluation information after the feedback control.

Through an embodiment of the present invention, to provide a clothing processing apparatus capable of providing an augmented reality image or animation converted according to the current object processing situation and a control method thereof so that the user can intuitively grasp the current object processing situation. do.

[Means to solve the problem]

In order to achieve the above object, according to an embodiment of the present invention, for washing or rinsing, the pumping step of driving the drum or driving a pulsator for forming a water stream so that washing water and cloth flow in the drum; Generating a time series image of the flow of the fabric by photographing the inside of the drum through a camera in the lifting step; Determining a current flow state of the fabric through the time series image; Performing additional water supply by driving a water supply valve according to the flow state of the fabric; In addition, a control method of a washing apparatus including performing washing or rinsing by driving the drum or pulsator after additional water supply may be provided.

A display step of visually providing the time series image to a user through a display may be included.

The drum or pulsator may rotate for a set time in one direction, and may rotate again for a set time after stopping. Washing/rinsing can be performed by repeating this. In addition, after repeating rotation in one direction, rotation in the other direction may be repeated afterwards.

When the drum or pulsator rotates, an image may be generated at the point when a stop signal is applied to the motor. And likewise, an image can be created at the same point in time in the next rotation. Therefore, it is possible to intuitively grasp the movement state of the fabric between rotation and rotation, or clearly determine the movement state of the fabric through image analysis.

Specifically, the time series image is photographed and generated at a first time interval, and in the display step, a second time interval longer than the first time among the time series images is selected so that the user intuitively grasps the flow state of the fabric. A discrete time series image may be extracted and displayed. That is, while one rotation may generate multiple images, the extracted and displayed image may be one image per rotation.

The step of transmitting the time series image to an external terminal through a communication module may be performed. By monitoring these time series images with an external terminal, it can be intuitively known that washing/rinsing is properly performed.

A step of providing evaluation information on the current flow state of the fabric identified through the time series image to a user through a user interface may be performed.

A plurality of evaluation information may be provided, and may include extracting any one evaluation information corresponding to a current flow state of the fabric from among the plurality of evaluation information.

It is preferable that the extracted evaluation information is provided to the user.

In order for the user to intuitively grasp the flow state of the fabric, an augmented reality image may be prepared and displayed for each of the plurality of evaluation information.

The augmented reality image may appear superimposed on a displayed time series image.

Animation may be prepared and displayed for each of the plurality of evaluation information so that the user can intuitively grasp the pos-dispersity.

The animation may be displayed by replacing the time series image.

The step of receiving water level information from a user through the user interface may be included.

The washing or rinsing step is preferably performed after controlling the water level by reflecting the water level information input by the user.

After the water level control, evaluation information may be re-extracted and provided to the user.

After the water level control, it may include the step of feedback control of the RPM of the drum or pulsator according to the re-extracted evaluation information.

The washing or rinsing step may be performed with the feedback-controlled RPM of the drum or pulsator.

Therefore, for optimal laundry flow, the washing machine itself can actively control the water level and/or RPM, and provide relevant information to the user so that the user can actively command the control to change the water level/or RPM. have.

In order to achieve the above object, according to an embodiment of the present invention, for washing or rinsing, the pumping step of driving the drum or driving a pulsator for forming a water stream so that washing water and cloth flow in the drum; Generating a time series image of the flow of the fabric by photographing the inside of the drum through a camera in the lifting step; Determining a current flow state of the fabric through the time series image; Feedback control of RPM of the drum or pulsator according to the flow state of the fabric; There may be provided a control method of a washing apparatus comprising the step of performing washing or rinsing by driving the drum or pulsator with the feedback-controlled RPM.

According to the flow state of the fabric, it may include the step of additionally supplying water by driving a water supply valve.

According to the flow state of the fabric, the washing and rinsing steps may be performed by increasing the RPM and increasing the water supply amount to increase the flow of the fabric, and decreasing the RPM to reduce the flow of the fabric. have.

Features in the above-described embodiments may be implemented in combination in different embodiments, unless contradictory or exclusive with each other.

According to an embodiment of the present invention, it is possible to determine whether an object is being processed optimally through time series information generated through a camera, and feedback control of a driving unit or an actuator so that the object is optimally processed. It is possible to provide a laundry treatment apparatus and a control method thereof.

According to an embodiment of the present invention, it is possible to provide a laundry treatment apparatus and a control method thereof capable of improving laundry performance and minimizing damage to the fabric by performing an optimal fabric flow during washing or rinsing.

According to an embodiment of the present invention, it is possible to provide a clothing processing apparatus and a control method thereof capable of providing a current object processing situation to a user through time series images or image information. In particular, it is possible to provide a laundry treatment apparatus and a control method thereof capable of providing information on a current object treatment situation and evaluation information on the same to a user. For example, it is possible to provide information on a processing situation indicating that the foam dispersion is being performed for the main dehydration entry, evaluation information that the degree of foam dispersion is one of upper and lower, feedback control information to increase the degree of foam dispersion, and evaluation information after the feedback control. .

Through an embodiment of the present invention, a clothing processing apparatus capable of providing an augmented reality image or animation converted according to the current object processing situation and a control method thereof so that the user can intuitively grasp the current object processing situation. I can.

1 is a perspective view showing the appearance of a washing apparatus according to an embodiment of the present invention,

2 is a cross-sectional view showing a cross-section of a washing apparatus according to an embodiment of the present invention;

3 is a block diagram of a control configuration of a washing apparatus according to an embodiment of the present invention;

4 is a flowchart of a method for controlling a washing apparatus according to an embodiment of the present invention;

5 shows an example of a time series image acquisition time point and a time series image,

6 shows the degree of slippage and the control relationship between the motor and the water supply valve,

7 shows an example in which the state of the mammalian movement is displayed.

Hereinafter, a home appliance and a control method thereof according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

First, an example of a washing machine that can be applied to an embodiment of the present invention will be described in detail with reference to FIGS. 1 to 2. The illustrated washing machine may be referred to as a vertical axis washing machine or a top loading washing machine.

The case 1 has a side cabinet 2 that forms a side surface of the washing machine and a top cover 3 installed to cover the open upper surface of the side cabinet 2, and the upper and lower surfaces thereof are open. It may include a base (5) installed on the open bottom of the cabinet (2).

In the cabinet 2, an outer tub 4 for receiving washing water, an inner tub 6 disposed inside the outer tub 4 and receiving a laundry cloth, and a motor 8b and a motor for driving the inner tub 6 A drive device (8) including a shaft (8a) that transmits the driving force of 8) to the inner tank (6), etc., and a water supply means (20) including a water supply valve (12) to supply water to the inside of the outer tank (4). ), and a drainage assembly 20 including a drainage pump 24 may be disposed to drain the water in the outer tub 4 after washing or dehydration is completed.

Here, the outer tub can be referred to as a tub and the inner tub may be referred to as a drum.

In the case of a washing machine, the object may be referred to as clothing, and the object treatment may be referred to as washing. In addition, the inner tank 6 may be referred to as an object receiving portion for accommodating the object of clothing. Of course, such an object, the treatment of the object, and the object receiving unit may be different for each home appliance as described above.

The water supply means 30 further includes a detergent box 32 installed on the top cover 3 to temporarily store detergent. The detergent box 32 may be accommodated in the detergent box housing 31. The detergent box 32 may be attached to and detached from the detergent box housing 31 in the form of a drawer.

The water supply means 30 may include a water supply valve 12 and a water supply hose 13. The water supply valve 12 may be connected to the external hose 11, and through the external hose 11, washing water may be supplied from an external water supply source.

The water supply hose 13 may be connected to an external water supply source capable of supplying hot and cold water. That is, a hot water hose and a cold water hose may be separately provided. In this case, the water supply valve 12 may include a hot water supply valve and a cold water supply valve provided separately.

Therefore, when the water supply valve 12 is opened, hot or cold water can be supplied to the detergent box 32 individually or simultaneously. In addition, the supplied washing water may be supplied to the inner tank 6 together with a detergent.

The detergent box 32 may be positioned to correspond to the open upper portion of the inner tub 6. In addition, the washing water may be supplied to fall toward the bottom surface of the inner tank 6. Therefore, as the washing water is supplied, the laundry cloth accommodated in the inner tank 6 gets wet to some extent through the falling washing water. Of course, washing water containing detergent will wet the laundry cloth.

The top cover 3 is formed with a cloth entry hole 3a so that the laundry cloth can be inserted or taken out. The top cover 3 is provided with a door 40 for opening and closing the cloth entry hole 3a. At least a portion of the door 40 may be made of glass so that the interior thereof can be seen. That is, the door 40 includes a frame portion 40a and a glass portion 40b fitted to the frame portion 40a.

In addition, a control panel 7 is mounted on one side of the top cover 3 to input the operation of the washing machine or display the operation state of the washing machine. A user interface 80 may be provided on the control panel 7. The control panel 7 to the user interface 80 may be provided to be distinguished from the cabinet 1 and the door 40, and may be provided as part of them. The user interface may include a display, various buttons or switches, various selection means or light emitting units.

The user can input or select object processing information through the user interface. In addition, the currently processed object processing information may be recognized through the user interface. Accordingly, the user interface can be regarded as an input means for inputting information and an output means for outputting information.

The outer tub 4 is disposed to be suspended by a plurality of suspensions 15 on the inner upper portion of the cabinet 1. One end of the suspension 15 may be coupled to an upper inner side of the cabinet 1 and the other end may be coupled to a lower portion of the outer tub 4.

A pulsator 9 is installed on the bottom of the inner tub 6 to form a rotational flow of water accommodated in the outer tub 4. The pulsator 9 is formed integrally with the inner tub 6, so that when the motor 8 rotates, the inner tub 6 and the pulsator 9 may rotate together. In addition, since the pulsator 9 is formed separately from the inner tub 6, it is possible to rotate separately when the motor 8 rotates. That is, only the pulsator 9 may rotate, and the pulsator 9 and the inner tank 6 may rotate at the same time.

A balancer 12 is installed on the upper side of the inner tub 6 to prevent the inner tub 6 from losing its balance due to the bias of the fabric. The balancer 12 may be a liquid balancer in which a liquid such as salt water is filled therein.

An outer tub cover 14 is installed on the upper side of the outer tub 4 to prevent separation of the cloth or scattering of water.

Referring to FIG. 2, the drain assembly 20 includes a drain pump housing including a first drain hose 21 connected to a drain hole 26 formed on the lower surface of the outer tub 4, and a drain pump for pumping water. (24) and a second drain hose (25) connected to the drain pump housing (24) to drain the water pumped by the drain pump to the outside of the cabinet (2). A drain motor for driving the drain pump is embedded in the drain pump housing 24. The drainage assembly 20 may be disposed between the outer tub 4 and the base 5.

A washing heater 50 for heating washing water and a heater cover 60 covering an upper side of the heater 50 may be mounted under the outer tub 4.

As shown in FIG. 2, the home appliance according to an embodiment of the present invention may include a camera 45. The camera may be provided in the cabinet 1 or the door 40 and may be provided to generate image information of an object provided inside the object receiving portion.

For example, it may be provided to generate image information by photographing clothing accommodated in the inner tub 6. The camera 45 may include an image sensor and a lighting device. The lighting device may include an LED, and the image sensor may be an RGB camera.

The camera 45 may be provided on a rear surface or a lower surface of the door 40. That is, this is because when the door 40 is closed, the rear or lower surface of the door 40 may face the inside of the object receiving portion. Accordingly, the camera 45 may generate image information on the object while the door is closed. This image information can be used in a learning process to be described later.

Inside the object receiving part, an environment for processing the object is created, and this environment is different from the external environment. In particular, the temperature or humidity is different. In the case of a washing machine, washing water is accommodated in the object receiving portion. Therefore, it is common to perform such object treatment while the door 40 is closed.

To this end, a door sensor 50 for detecting a closed state of the door 40 may be provided, and the door sensor 50 may be provided in a door or a cabinet 1 corresponding to the door. For example, a door sensor 50 may be provided on the top cover 3. When detecting that the door is in a closed state through the door sensor 50, the object is processed.

Likewise in this embodiment, the door sensor 50 may be provided. However, the door sensor 50 in the present embodiment may be provided not only to detect the closed state of the door but also to be interlocked with the operation of the camera 45.

That is, the generation time of image information through the camera 45 may be related to the detection time of door closing by the door sensor 50. For example, when the door sensor 50 detects the closed state of the door, the camera 45 may generate image information.

To operate the camera 45 and the door sensor 50, power must be applied to these components. A home appliance such as a refrigerator is always powered, but in general, clothes processing devices such as a washing machine, dryer, dishwasher, oven, and styler may be home appliances to which the power is not always applied.

3 shows a control configuration of a laundry treatment apparatus according to an embodiment of the present invention.

Basically, the main control unit or the processor 100 is provided, which may be mounted inside the control panel. The operation of the laundry treatment apparatus may be controlled through the processor.

The controller may control the operation of various hardware. The motor 8a, the drain pump 24, the water supply valve 12, the water level sensor 36, and the like may be appropriately controlled to perform the washing course.

The laundry treatment apparatus according to the present embodiment may include a user interface (UI) 80. The UI may include various buttons or rotary knobs, and in particular, may include a display. Through the UI, the user can input object processing information to the clothing processing apparatus. In addition, through the UI, the clothing processing apparatus may provide the user with object processing information input by the user and currently being performed.

In particular, the display may be implemented as a touch display. Through this, both the user's input of information and the display of information of the clothes processing apparatus can be performed.

Through the display, characters, numbers, or images may be displayed, and as will be described later, time series images, augmented reality images, or animations may be displayed. Accordingly, the user can intuitively grasp the current object processing information and situation of the laundry treatment apparatus.

The laundry treatment apparatus according to the present embodiment may include a communication module 90. Through the communication module 90, the laundry treatment apparatus may be connected to an external server to transmit and receive information. The clothing processing apparatus may transmit and receive information to and from the user's terminal through an external server.

For example, a user may input a remote control command through an external terminal. Such a remote control command is transmitted to the laundry treatment apparatus through a server, so that the clothes treatment apparatus may be remotely controlled.

When the user remotely commands the clothing processing apparatus to process clothing, the clothing processing apparatus may transmit current state information to the server while processing the clothing. The server may transmit this to the user's external terminal. Therefore, the user can easily grasp the current clothing treatment information through the external terminal.

In this embodiment, it can be said that the camera is mounted. The camera 45 may be provided on the door 40 to take a picture of the inside of the inner tank 6. In other words, it is possible to photograph the flow of clothing, which is an object, inside the inner tank 6. In addition, the flow of washing water can be photographed. Through such photographing, image information may be generated or a time series image may be generated.

The image information is a set of images continuously photographed for a predetermined time, and when the image information is displayed, the user can grasp the current rotation of the inner tub and the flow state of the clothing. In addition, it is possible to grasp the relationship between the flow of washing water and the flow of clothes in the washing water.

However, it is difficult to determine whether or not the laundry flows inside the inner tank as intended during washing or rinsing. That is, as the inner tub rotates, it is difficult for a general user to determine whether the movement of the laundry is insufficient, appropriate, or excessive. This is because the general user cannot well know what the intended flow for the current laundry is.

Time series images can also be referred to as video information. Even if such time series image information is provided to the user as it is, the user may not be able to grasp whether the laundry flows optimally through the time series image.

Accordingly, the time series image in the present embodiment may be referred to as information generated at a second predetermined time interval that is later than the first predetermined time between image capture in general image information. Such a time series image may be generated by being extracted from the image information, or may be generated through an image captured at a second predetermined time interval.

Therefore, when a time series image is displayed, a user can view a discontinuous video. Through this time series image, the user can intuitively grasp the flow state or dispersion degree of the clothing. That is, even if not a designer or expert of the washing machine, a user can more intuitively grasp the flow state or dispersion degree of clothes through discontinuous time series information rather than continuous image information. Of course, through this time series image, it is possible to determine whether the clothes are flowing or dispersed as intended by the washing machine itself.

The time series image generated through the camera 45 in this embodiment can be used for effective object processing.

When washing, rinsing and dewatering are performed, the flow condition of the fabric is very important. That is, it can be said that there is an optimal flow state of the fabric for optimally performing washing, rinsing and dewatering.

In particular, in a vertical axis washing machine, it can be said that the degree of flow in the inner tank of laundry is very important.

In general, in a washing machine, water supply is performed based on a water level determined according to the amount of existing cloth, and washing or spinning is performed through a fixed drum motion control. In particular, washing or rinsing is performed by repeating rotation in one direction or in both directions at a predetermined RPM of the inner tub. Of course, washing or rinsing may be performed by repeating a pulsator other than the inner tub by rotating a predetermined one-way or two-way rotation.

However, the moisture content of the fabric may vary depending on the material of the fabric. That is, even though the water was supplied to the proper water level, the weight of the load and the degree of slippage vary depending on the material of the fabric. Therefore, there is a possibility that optimal washing or rinsing will not be performed.

However, according to an embodiment of the present invention, it is possible to provide a laundry treatment apparatus similar to the one in which a washing machine designer or developer directly sees the flow of clothes inside the inner tank and determines whether the flow of clothes is optimally generated. In addition, when the flow of clothes is not optimal, the flow of clothes can be performed optimally through feedback control of a driving unit or an actuator. Thus, washing or rinsing can be performed optimally.

Image information generated through the camera may be displayed through the UI 80. That is, by displaying image information such as image information as well as expression means such as characters or figures on the UI, the user can more intuitively grasp the current state information.

As described above, discontinuous time series information may be displayed instead of continuous image information. Through this discontinuous time series information, it is possible to more intuitively grasp the flow state of the fabric. In addition, an evaluation of the flow state of the fabric is performed, and such evaluation information may be used for feedback control of a driving unit or an actuator. In addition, evaluation information may be displayed on the UI 80. Details on this will be described later.

Hereinafter, a control method of a laundry treatment apparatus according to an embodiment of the present invention will be described in detail with reference to FIGS. 4 and 5.

FIG. 4 shows control flow steps, and FIG. 5 shows specific images and generation times of the specific images during a washing/rinsing process.

According to the present embodiment, image information or time series information using a camera may be used in the washing process (S10). In particular, the use of such image information may be used in a process (S14) in which the main washing is performed during the washing process. That is, this image information can be used in the main washing process in which the water supply is terminated and the inner tub or pulsator is driven in earnest to perform washing. Of course, the same can be used in the rinsing process (S20).

It can be determined whether the washing is smoothly performed through the image or information generated during the washing process. Specifically, washing may be performed by determining whether the flow of the fabric is the same as intended. More specifically, when the flow of the fabric is less than intended, the RPM is increased to promote the flow of the fabric, and when the flow of the fabric is larger than the intended flow, the RPM can be decreased to reduce the flow of the fabric.

That is, by controlling the RPM of the inner tank or the RPM of the pulsator differently, the flow of the fabric can be optimally controlled.

In general, washing can be performed by repeating rotation and stopping of the inner tub or pulsator in one direction. In the illustrated fabric flow control (S141), the driving control of the inner tank, that is, the flow control, is generally performed through a preset inner tank (pulsator) RPM and a preset actual motion rate. However, according to the present embodiment, the control pattern, particularly the RPM, in this sliding control can be varied.

The rotation of the inner tank will have approximately 40 to 50 RPM. As the inner tank rotates, the cloth rotates with the washing water. Mechanical force is applied to the laundry while repeating this flow. Of course, these RPMs may vary depending on the washing course. When strong washing is required, the rotational RPM of the inner tub is relatively large, and when weak washing is required, the rotational RPM of the inner tub may be relatively small.

Therefore, it can be said that the optimum RPM and the flow pattern of the laundry cloth intended from the optimum RPM under the current washing conditions are preset. In this embodiment, the flow pattern of the actual laundry cloth may be displayed as preset and optimized for current washing conditions.

On the other hand, when the laundry is immersed in the washing water and washing/rinsing is performed, the flow of the fabric is closely related not only to the rotation of the inner tub/pulsator but also to the amount of washing water. In particular, when the pulsator rotates, if a sufficient amount of washing water is not secured, there is a high possibility that the laundry does not flow sufficiently. In this case, laundry close to the pulsator, that is, laundry near the bottom of the inner tank, may sufficiently flow by the pulsator, but the laundry located at the top may not flow or flow very finely.

Therefore, it is preferable to control not only the RPM of the motor causing the rotation of the inner tank and the pulsator, but also the water supply amount.

In FIG. 6, an example of a feeding amount and motion control based on a mammalian movement is shown.

If the fabric flow level (level) is "medium", the motor RPM can be maintained and the current water level can be maintained without additional water supply. Of course, it can be controlled to add a small amount of washing water.

When the flow level of the fabric is "weak", the motor RPM is increased and additional water supply can be performed. In this case, an increase in motor RPM and additional water supply may be performed in parallel. However, the main cause of the low flow level of the fabric in the current state may be one of motor RPM and water level. Therefore, after the RPM increase control is performed first, the additional water supply can be performed only after the bubble flow level is weak. This is because, when more than necessary washing water is injected through additional water supply, waste of washing water is caused. After additional water supply of the washing water, the motor RPM can be controlled differently by re-evaluating the flow level of the fabric.

When the flow level of the fabric is "strong", control to reduce the motor RPM can be performed without additional water supply.

5 shows a change in the image generated as the rotation of the inner tub (or pulsator) is repeated during the washing process. It can be seen that the image at the end of the first rotation section, particularly the end of the first rotation and the image at the end of the second rotation section, particularly the second rotation, are different. Here, it is preferable that the image generation time point in one rotation section is the same as the image generation time point in the next rotation section. Since the largest change in flow may occur at the end of rotation, it is more preferable to create an image at the end of rotation.

As shown, it is possible to analyze the image change of the laundry after rotation. The degree of movement (rotation angle) of the laundry can be determined through matching of the laundry color and pattern pattern.

Of course, these images may be generated and displayed as moving pictures. However, in order for the control unit (processor, 100) to determine the bubble flow, a plurality of still images may be used in time series. That is, it can be determined whether the fabric flows optimally through the time series image.

Accordingly, while performing the washing process (S10, S14), time series information may be generated (S141), and the flow state of the fabric may be evaluated (S143). A plurality of evaluation information may be provided, and the controller 100 may extract matching evaluation information from among a plurality of evaluation information by analyzing the generated and acquired time series image.

For example, when the optimal lactation state can be evaluated as "high", the evaluation information may appear as "high, medium, low" or "strong, medium, weak". Of course, there is no limit to the method or number of expressing the degree of bubble flow. In addition, the degree of fabric flow may vary based on the intended fabric flow.

The control unit 100 generates evaluation information through time series information, and performs feedback control according to the evaluation information.

In the present embodiment, a feature capable of displaying by converting time series image information or evaluation information into intuitive information may be added.

Even if a camera is provided and optimally handles clothing using the camera, the user may have questions about how and why the camera is used. Accordingly, there is a need to provide a laundry treatment apparatus capable of increasing satisfaction by directly providing a generated image to a user.

The treatment of clothing is performed while the clothing is not in a fixed state, but is moving. In particular, it is very important how the clothing flows. If the designer or developer sees the actual washing, it is possible to evaluate the flow, but it is difficult for the user to see this and perform the flow evaluation.

Accordingly, an actual flow image or a discontinuous time series image can be provided to the user, but it is not easy for the user to evaluate the flow through this.

Therefore, it is possible to provide a user with an image, augmented reality, or animation converted or converted from an actual image or time series image. The provided information may be displayed on the UI 80.

7 shows an example in which an augmented reality image or animation is displayed on an actual image or a time series image of a fabric flow in a washing process.

A preview image or image is displayed, and in other words, an augmented reality image may be displayed as shown in FIG. 7 in a form superimposed thereon. The flow of the fabric can be intuitively displayed through the inner tank 6 and the fabric S, and the inner tank 6 and the fabric S can be displayed as rotating. Of course, it is desirable to allow the inner tank 6 and the fabric S to rotate at a slow speed so that the user can intuitively grasp and evaluate the flow state of the fabric.

For example, in augmented reality or animation, the inner tub 6 may be rotated and the fore S may be expressed as rotating based on the center of the inner tub.

Therefore, through this display, the user can intuitively grasp the flow of the fabric. And, it is possible to intuitively grasp the degree of flow of the fabric.

Preview images or images can be replaced with animations.

In addition, an actual image, an augmented reality image, or animation may be displayed, and evaluation information may be displayed if necessary.

That is, the step of providing the evaluation information determined by the control unit 100 to the UI may be performed. The provided evaluation information may be displayed on the UI 80.

It is also possible to request the user's remote control input by transmitting image information and evaluation information about the state of poor flow to the user's external terminal. As an example, it is possible to request the user to input whether or not to increase or decrease the drum RPM in order to satisfy the degree of flow of the fabric. After the feedback control is performed in response to the user's input, a different flow of the fabric before and after the feedback control may be provided to the user.

Accordingly, the user can feel the joy of controlling the clothing treatment device while looking at the clothing treatment device directly, and at the same time feel satisfaction with the clothing treatment.

Included in the detailed description of the invention.

Claims

For washing or rinsing, a feeding step of driving the drum so that the washing water and the cloth flow in the drum or a pulsator forming a water stream;

Generating a time series image of the flow of the fabric by photographing the inside of the drum through a camera in the lifting step;

Determining a current flow state of the fabric through the time series image;

Performing additional water supply by driving a water supply valve according to the flow state of the fabric; And

A control method of a washing apparatus comprising the step of performing washing or rinsing by driving the drum or pulsator after additional water supply.
The method of claim 1,

And a display step of visually providing the time series image to a user through a display.
The method of claim 2,

The time series image is photographed and generated at a first time interval,

In the display step, a discontinuous time series image having a second time interval longer than the first time from the time series image is extracted and displayed so that the user can intuitively grasp the flow state of the fabric.
The method of claim 1,

And transmitting the time series image to an external terminal through a communication module.
The method of claim 1,

And providing evaluation information on the current flow state of the fabric identified through the time series image to a user through a user interface.
The method of claim 5,

The plurality of evaluation information is provided, and the method of controlling a washing apparatus, comprising the step of extracting any one evaluation information corresponding to a current flow state of the fabric from among the plurality of evaluation information.
The method of claim 6,

The control method of a washing apparatus, characterized in that the extracted evaluation information is provided to a user.
The method of claim 7,

An augmented reality image is prepared and displayed for each of the plurality of evaluation information so that the user intuitively grasps the flow state of the fabric.
The method of claim 8,

The augmented reality image is superimposed on the displayed time series image.
The method of claim 7,

An animation for each of the plurality of evaluation information is provided and displayed so that the user can intuitively grasp the cloth dispersion.
The method of claim 10,

And the animation is displayed by replacing the time series image.
The method of claim 7,

And receiving water level information from a user through the user interface.
The method of claim 12,

The washing or rinsing step is performed after controlling the water level by reflecting the water level information input by the user.
The method of claim 13,

After controlling the water level, the evaluation information is re-extracted and provided to the user.
The method of claim 14,

And feedback control of RPM of the drum or pulsator according to the re-extracted evaluation information after the water level control.
The method of claim 15,

Washing apparatus, characterized in that performing the washing or rinsing step with the feedback-controlled RPM of the drum or pulsator.
The method of claim 1,

Control method of the washing apparatus, characterized in that the water level control through the water supply valve driving is automatically performed.
For washing or rinsing, a feeding step of driving the drum so that the washing water and the cloth flow in the drum or a pulsator forming a water stream;

Generating a time series image of the flow of the fabric by photographing the inside of the drum through a camera in the lifting step;

Determining a current flow state of the fabric through the time series image;

Feedback control of RPM of the drum or pulsator according to the flow state of the fabric;

And performing washing or rinsing by driving the drum or pulsator with the feedback-controlled RPM.
The method of claim 18,

And additionally supplying water by driving a water supply valve according to the flow state of the cloth.
The method of claim 19,

According to the flow state of the fabric, the RPM is increased and the water supply amount is increased to increase the flow of the fabric, and the RPM is decreased to reduce the flow of the fabric, and the washing and rinsing steps are performed. The control method of the washing device.