WO2023280576A1

WO2023280576A1 - Control of a household appliance

Info

Publication number: WO2023280576A1
Application number: PCT/EP2022/067084
Authority: WO
Inventors: Philip Koene; Manuel KIRSCHNER
Original assignee: BSH Hausgeräte GmbH
Priority date: 2021-07-08
Filing date: 2022-06-23
Publication date: 2023-01-12
Also published as: DE102021207182A1; CN117677324A

Abstract

The invention relates to a household appliance comprising a functional component; a control device for controlling the functional component; and a microphone which is inside the household appliance for detecting a sound caused by the functional component. According to the invention, the control device is designed to determine an operating condition of the household appliance based on a detection and to control the functional component in accordance with the operating condition.

Description

Control of a household appliance

The invention relates to the control of a household appliance. In particular, the invention relates to the detection of an operating state of the household appliance.

A household appliance is set up to be used in a household. For example, the household appliance can be provided for laundry care, as a kitchen appliance or for cleaning the household. Exemplary household appliances include a vacuum cleaner, a stove, a coffee maker, a washing machine, a dishwasher, a tumble dryer or an iron. Each household appliance can have one or more sensors in order to improve the task assigned to it. The household appliance can control a complex process, for example the preparation of a large number of different coffee specialties based only on water, coffee beans and milk.

Under certain conditions, the household appliance cannot fulfill its purpose satisfactorily. For example, a supply of equipment can be exhausted or a functional component can be defective. Dedicated sensors can be provided to detect such conditions. However, there are other operating states that can prevent the household appliance from functioning or require user intervention. For example, a clothes dryer may accidentally be loaded with a hard object; an auxiliary component of the household appliance can be defective or a sensor can provide an implausible sensor value. However, subtle or vague indications of a problem in the performance of the appliance's function usually go unnoticed.

An object underlying the present invention is to specify an improved technique for controlling a household appliance. The invention solves this problem by means of the subject matter of the independent claims. Subclaims give be preferred embodiments.

According to a first aspect of the present invention, a household appliance includes a functional component; a controller for controlling the functional component; and a microphone within the household appliance for sampling a noise caused by the functional component. The control device is set up to determine an operating state of the household appliance on the basis of a scan and to control the functional component as a function of the operating state. The invention is based on the idea that background noise within the household appliance can provide an indication of its operating status. A noise caused by the functional component, in particular an operating noise, can be changed depending on the prevailing circumstances, for example how full an operating medium container is, a temperature, a position of another component or a controlled activity of the household appliance. Noises that can be scanned using the microphone can be assigned to an operating state on the basis of their acoustic signature. In this way, known unproblematic, known problematic and also unknown operating states can be identified.

In a first variant, it can be determined whether noises sampled by means of the microphone indicate a problematic operating state. In a second variant, it can be determined whether the noises belong to an unknown operating state. In both cases, an adapted control of the functional component can be assigned to the operating state. If the operating state permits another function of the household appliance, then the functional component can be controlled in such a way that the operating state is influenced in a predetermined manner. In this way, the household appliance can react better to foreseeable or unforeseeable influences and, under certain circumstances, ensure its function. If it is determined that the operating condition does not permit operation of the household appliance, there is a risk of the operating condition deteriorating, in particular promoting a defect in a component of the household appliance, equipment or a user in the area of the household appliance is at risk, or no reliable statement is possible on the operability of the household appliance, the functional component can be turned off. Here, too, an attempt can be made to bring the household appliance into a safe state.

It is preferred that the household appliance includes a housing, with the microphone and the functional component being provided inside the housing. In contrast to a pickup, the microphone is set up to sample airborne noise, i.e. pressure fluctuations in the atmosphere inside the household appliance. The microphone can be placed in such a way that it is indirectly affected by a noise caused by the functional component. A propagation path of sound between the functional component and the microphone can lead via a component that influences the noise or is superimposed with another noise. In one embodiment, the microphone has an omnidirectional characteristic, so that sound can find its way from the functional component to the microphone on different paths within the housing. As a result, a holistic acoustic impression of a function or an operating state of the household appliance can be obtained.

It is preferred that an operating condition requiring user intervention is determined. In particular, the operating state can include that permanent operation of the household appliance under the present conditions cannot or should not be continued. If there is no known problem associated with the particular operating condition, the user may be prompted to confirm that there is in fact no problem. The operation of the household appliance can then be continued. A noise assigned to the operating state can be stored or learned, so that the operating state can be recognized in the future and evaluated depending on the user's input.

The operating state can be detected on the basis of the noise, in particular by detecting an acoustic signature of the noise. Methods of machine learning, in particular artificial intelligence, can be used for this. In one embodiment, an operating state can be detected using a neural network that is fed with a signal from the microphone. The neural network is trained to recognize one or more predetermined operating states based on respectively assigned acoustic signatures. To train the network, the household appliance can be repeatedly brought into a predetermined operating state and a noise associated therewith can be presented to the neural network as part of supervised learning. The operating state can be assumed several times, preferably by means of several household appliances of the same construction, with the noise being recorded in each case and a learning process being used as a basis.

It is preferred that the control device is set up to recognize a large number of predetermined operating states of the household appliance. In this way, a differentiated statement can be made about the operability or an advisable procedure for controlling the household appliance. The more complex a range of functions of the household appliance, the greater the number of recognizable operating states. With a simple device, for example, 10 operating states can be distinguished, with a complex device several 10, several 100 or even more operating states can be distinguished.

It is also preferred that the household appliance comprises a plurality of functional components, with the control device being set up to determine the operating state on the To determine the basis of noise of the functional components. The functional components can interact and each produce noise that can be superimposed on the microphone. A noise provided by a functional component can also be modified by another functional component, for example with regard to an attenuation of certain frequencies or in the case of multiple propagation (“multipath”) in the device.

It is also preferred that a number of microphones are provided within the household appliance, with the control device being set up to determine the operating state on the basis of scanning of the microphones. The microphones can be provided at different locations within the household appliance. With the right placement, an improved overall acoustic picture of the operating status can be sampled.

The control device is preferably set up to control the functional component in a predetermined time sequence in which the functional component causes different noises. Furthermore, the control device is configured to determine the operating state on the basis of sounds sampled during the course. For example, the timeline may include performing multiple sub-steps of a process that provides a desired end product. In the case of a coffee maker, this may include grinding coffee beans, brewing the ground beans, and frothing milk. The phases can be evaluated acoustically individually or an operating state can be determined that includes several or all phases.

It is generally preferred that noises that do not contribute to or cause the operation of the household appliance are not taken into account. In particular, noises that are uncorrelated with a function of the household appliance can be filtered out. In one embodiment, a further microphone is provided for detecting a noise caused outside the household appliance. In this case, the control device is set up to remove the noise caused outside the household appliance from a signal from the microphone fitted inside the household appliance. An acoustic interference signal from outside the household appliance can thus be removed from the useful signal from inside the household appliance. This principle is known as “noise cancelling”. In some cases, a noise caused by the functional component but occurring outside the household appliance may be taken into account for determining the operating state. For example, an induction cooker can heat a pot of water until the water boils. The sound of boiling water is caused by a functional component of the cooker, namely an induction coil, and occurs outside the appliance. In this case, the microphone provided outside the device can also provide a sample based on which the operating state can be better determined.

In a further embodiment, the operating state includes a defect in the functional component. If several functional components are provided, a distinction can be made as to which functional component is affected by the defect. In particular, it can be decided which functional component is the cause of a changed or impaired function of another functional component. The defect can thus be characterized more precisely. The control of the household appliance or its functional components can be improved as a result.

In yet another specific embodiment, the control device is set up to determine an operating state in which a function of the functional component is influenced by an external situation. In particular, it can be determined that the functional component itself is free of defects. However, an event or condition affecting the functional component can affect its intended function. For example, the functional component can be set up to act on an external object or to use a medium, an operating substance or an auxiliary substance. If the object, the medium, the operating material or the auxiliary material is not available in the way that was expected, the functional component can be influenced as a result. For example, a blender that is not immersed in a substance to be processed can make a characteristic operating noise that indicates a lack of the substance. Similarly, a coffee maker that has no coffee beans or water available may produce a distinctive noise when operating.

The domestic appliance can include an output device, with the control device being set up to provide an indication of a specific operating state. The output device can be directed at a person in the vicinity of the household appliance or can be set up to be connected to another device. In a further embodiment, the output device comprises a wireless interface that is set up to indicate a predetermined, remote device. advises to send. This device can in particular include a mobile device, in particular a mobile phone or a tablet computer, of a user or another person responsible for the household appliance. In yet another embodiment, information about specific operating states of a large number of different household appliances can be collected and evaluated centrally.

According to a second aspect of the present invention, a method for controlling a household appliance with a functional component comprises the steps of sampling a noise caused by the functional component within the household appliance; determining an operating state of the home appliance based on the sampled noise; and controlling the functional component as a function of the determined operating state.

The method can be carried out by means of a processing device which is part of a domestic appliance described herein. For this purpose, the method can be in the form of a computer program product with program code means. The processing device may comprise a programmable microcomputer or microcontroller. The computer program product can also be stored on a computer-readable data carrier. Features or advantages of the method can be transferred to the device or vice versa.

The invention will now be described in more detail with reference to the accompanying figures, in which:

FIG. 1 shows a schematic representation of an exemplary household appliance; and FIG. 2 shows a flow chart of a method for controlling a household appliance.

Figure 1 shows a schematic representation of an exemplary household appliance 100. Purely by way of example, the household appliance 100 is designed as an integrated coffee machine; in other embodiments, however, the household appliance 100 can also comprise another appliance to be used in a household. The household appliance 100 comprises a functional component 105 and a control device 110. Several functional components 105 are provided here, namely a pump 115 and a heater 120. In addition, at least one internal microphone 125 fitted inside the household appliance 100 and, optionally, an external microphone 130 are provided. The internal Microphone 125 is set up to sample a noise that is caused by a functional component 105 of the household appliance 100 . The internal microphone 125 is preferably located together with the functional component 105 in a housing of the household appliance 100. The external microphone 130 is set up to capture a noise that was caused outside the household appliance 100. In particular, the noise can be caused by a person or another object in the area of the household appliance 100 .

The control device 110 is preferably set up to control a function of the household appliance 100 . For this purpose, the control device 110 can in particular control one or more functional components 105 . More preferably, the control device 110 is set up to determine an operating state of the household appliance 100 on the basis of noises that can be sampled using the microphones 125 and 130 .

In a simplified example relating to the illustrated coffee maker 100, water is provided in a container 135 which can be pressurized by the pump 115 and heated by the heater 120 to be forced through ground coffee beans. The resulting coffee drink can be caught in a cup 140 .

During the preparation of the coffee drink, the pump 115 in particular can emit a characteristic noise, which can be picked up by means of the internal microphone 125. Ambient noises that can be detected by means of the external microphone 130 can be compensated for, so that noises within the household appliance 100 can be viewed in an improved isolated manner. Based on the detected noises, it can be determined whether the home appliance 100 is operating properly.

However, if the container 135 is empty, the pump 115 can cause a different noise, which can be determined by means of the internal microphone 125 and recognized by the control device 110 . In order to prevent the heater 120 from being thermally overloaded due to a lack of water, the pump 115 and the heater 120 can be switched off.

An indication of the specific operating state can also be provided by means of an optional output device 145 . In the illustrated embodiment, the output device 145 includes a wireless interface for communicating with a remote device. This can be assigned in particular to a user who can intervene in the operation of the household appliance 100 or ensure operability. In the example above, the user can be informed of a lack of water in the container 135, for example, which he can remedy by refilling the container 135 with water. In another embodiment, a local output device 145 is provided on the household appliance 100, which can inform the user of the specific operating state in a visual, acoustic or haptic manner, for example.

FIG. 2 shows a flow chart of a method 200 for controlling a household appliance 100. The method 200 can be carried out in particular by means of a control device 110.

In a step 205, an internal noise of the household appliance 100 can be detected, as indicated by a symbolic graphic representation of a sound recording. One or more internal microphones 125 can be used for this purpose. In a concurrent step 210, an external noise can be detected on the household appliance 100, which is also indicated symbolically as a graphic representation. The detection can take place in particular by means of the external microphone 130 .

In a step 215, the detected noises can be processed, compensated for, mixed, weighted or otherwise combined with one another. In particular, noise caused outside of the household appliance 100 can be removed from signals that are each caused by one or more functional components 105 of the household appliance 100 and sampled inside the household appliance 100 . The aim of the compensation is to isolate noises that indicate an operating state of the household appliance 100 and to suppress other noises. Sounds from different internal microphones 125 can be combined or viewed separately. Signals that were detected at different points in the household appliance 100 can also be subtracted from one another in such a way that a specific noise or a noise at a predetermined point in the household appliance 100 is isolated.

In a step 220 an operating noise of the household appliance 100 can be detected. The operating noise can result from the totality of several noises, each of which was caused by a functional component 105 of the household appliance 100 . Optionally, a time profile of the noises can also be taken into account. In particular, the noises can be correlated with a control of the functional components 105 that is taking place.

A known noise can be associated with an operating condition. An unfamiliar noise can also be identified. A noise, especially if it indicates an unknown or undesired operating condition, can be localized in the household appliance 100 . A component of the home appliance 100 that may be causing the noise can be identified based on the localization.

In a step 225, an operating state of the household appliance 100 can be determined on the basis of one or more detected noises and possibly taking into account an activation of functional components 105. If a noise can be detected but not recognized, this can indicate an undefined or unknown operating condition. The determined operating condition can be evaluated. For example, the operating state can be assigned to a class of operating states that require a predetermined response. In a step 230, a notification may be provided indicative of the particular operating condition. This can include a request to carry out a predetermined action. This action may be intended to resolve a problematic operating condition. The action can usually be performed by a person in the area of the household appliance 100 .

In addition, in a step 235, a functional component 105 of the household appliance 100 can be controlled as a function of the operating state determined. If it is an undesired operating state, an attempt can be made to control at least one functional component 105 in such a way that a less undesired operating state is assumed.

The following table shows other exemplary operating states that can be recognized from background noise and the associated reactions as examples. Device Audible Signature Response

gas stove gas flow without flame turn off gas flow; issue an audible alarm; Call the emergency

Gas stove Gas flame burns for a long time Turn off gas flow; audible alarm time; do not spend human activity; Making an emergency call detected in the area

Stove boiling liquid in warming Turn off stove; issue audible alarm tem vessel; provide notification

Dishwashers Water beads up on plastic objects in the cleaning area

Dishwasher spray arm emits an acoustic alarm due to an object that is too large; Provide notification if blocked in cleaning room

Washing machine Imbalance in a washing drum Stop the drum; through pre-machined, adjusted rotating sequence newly balanced dryer; provide notification

Reference sign

100 home appliance

105 functional component

110 controller

115 pump

120 heating

125 internal microphone

130 external microphone

135 containers

140 cup

145 dispenser

200 procedures

205 capture internal noise

210 capture external noise

215 Compensate for noise

220 detect noise

225 determine operating status

230 Send notification

235 control functional components

Claims

PATENT CLAIMS

A household appliance (100) comprising:

- a functional component (105);

- A control device (110) for controlling the functional component (105); marked by

- A microphone (125) within the household appliance (100) for scanning a noise caused by the functional component (105);

- Wherein the control device (110) is set up to determine an operating state of the household appliance (100) on the basis of a scan and to control the functional component (105) depending on the operating state.

2. Household appliance (100) according to claim 1, wherein the operating state requires user intervention.

3. Household appliance (100) according to claim 1 or 2, wherein the control device (110) is set up to detect a plurality of predetermined operating states of the household appliance (100).

4. Household appliance (100) according to any one of the preceding claims, wherein a plurality of functional components (105) are provided and the control device (110) is adapted to determine the operating state on the basis of noise from the functional components (105).

5. Household appliance (100) according to one of the preceding claims, wherein a plurality of microphones (125) within the household appliance (100) are provided and the control device (110) is set up to scan the operating state on the basis of from the microphones (125) to determine.

6. Household appliance (100) according to one of the preceding claims, wherein the control device (110) is set up to control the functional component (105) in a predetermined time sequence in which the functional component (105) un- different noises; and determine the operational status based on sounds sampled during the course.

7. household appliance (100) according to any one of the preceding claims, further comprising a further microphone (130) for detecting an outside of the household appliance (100) caused noise; wherein the control device (110) is set up to remove the noise caused outside the household appliance (100) from a signal from the microphone (125) fitted inside the household appliance (100).

8. Household appliance (100) according to any one of the preceding claims, wherein the loading operating state includes a defect in the functional component (105).

9. Household appliance (100) according to one of the preceding claims, wherein the control device (110) is set up to determine an operating state in which a function of the functional component (105) is influenced due to an external fact.

10. household appliance (100) according to any one of the preceding claims, further comprising an output device (145); wherein the control device (110) is set up to provide an indication of a specific operating state.

11. Method (200) for controlling a household appliance (100) with a functional component (105), the method (200) comprising the following steps:

- Scanning (205) by the functional component (105) caused Ge noise inside the household appliance (100);

determining (225) an operating state of the household appliance (100) on the basis of the sampled noise; and

Controlling (235) the functional component (105) depending on the determined operating state.