DE102013223949A1 - Method for enabling remote control and / or remote monitoring of the operation of household appliances by means of a communication device and corresponding system - Google Patents

Abstract

The invention relates to a method for enabling a remote control and / or remote monitoring of the operation of at least one home appliance (9) of a user by means of a communication device (4) communicating with an internet server (2) by: establishing a communication connection from the communication device (4) to the Internet server (2); Receiving an authentication input of the user by the communication device (4) and transmitting the authentication input from the communication device (4) to the internet server (2); Comparing the authentication input with data stored on the Internet server (2) and authenticating the user depending on the comparison; and enabling the remote control and / or remote monitoring after successful authentication, wherein at least one reference image (15) of an interior space and / or a surrounding area of the household appliance (9) is arranged by means of a camera (12) arranged on and / or in a domestic appliance (9). and at least one image region of the reference image (15) is transmitted to the communication device (4) and displayed together with at least one further image (16) on a display (5) of the communication device (4), the authentication input selecting one of the displayed Images (15, 16) by the user and the authentication takes place depending on the selection.

Description

The invention relates to a method for enabling a remote control and / or remote monitoring of the operation of at least one home appliance of a user by means of a separate communication device from the household appliance, which communicates with an Internet server. A communication connection is established from the communication device to the internet server. The communication device receives an authentication input of the user, which is made by the user at an input device of the communication device. The authentication input is transmitted from the communication device to the Internet server. On the Internet server, the authentication input is then compared with data stored on the Internet server, and the user is authenticated depending on the comparison. Remote control and / or remote monitoring is enabled after successful authentication. The invention also relates to a system which is designed to carry out such a method.

It is already state of the art to equip household appliances with a communication module, via which the household appliances are connected to the Internet. The home appliances can then communicate with an Internet server, allowing for remote monitoring and remote control of household appliance operation. A data communication between household appliances on the one hand and an Internet server on the other hand, for example, by the system "Home Connect" allows, which is offered by the home of the applicant.

The user of the household appliances has the possibility of using an appropriate communication device - for example, a mobile communication terminal (eg a mobile phone or a tablet PC) or a conventional PC - to access the Internet server and control the operation of household appliances through the Internet server monitor. In this case, for example, control commands can be transmitted to the household appliances, which are generated as a function of operator inputs of the user at his communication device. On the other hand, it is also possible to transfer state data of the household appliances to the Internet server and to make it available to the user. This data can then be displayed on a display of the user's communication device.

Personal data of the user are usually associated with a user account, which is maintained on the Internet server. It is therefore assumed that an appropriate user account has been created on the Internet server. This user account can then be assigned to a variety of different household appliances, which can be controlled remotely or remotely from the user account. In each user account so several household appliances can be registered. The access to the data of each user account presupposes that the user has to enter his user name (identifier) and usually a password and thus has to authenticate himself. This identification data of the user can be entered, as is known, on a PC or on a portable communication terminal by using a conventional keyboard of the PC or the virtual keyboard of the portable communication terminal.

For the protection of user accounts, therefore, it is possible to use purely knowledge-based mechanisms which are based on the exclusive knowledge of the user himself. Here, for example, the user must have his or her secret password, a PIN or an input pattern ready to be able to authenticate himself successfully on his user account. On the other hand, to secure user accounts, so-called multi-factor authentication mechanisms are used, which are based on the one hand on the exclusive knowledge of the user (e.g., password) and on the other on additional ownership, such as unique certificates, fingerprints, and the like. Because abstract knowledge - such as cryptic passwords - is usually relatively hard to remember, it rarely or never changes. On the other hand, users also tend to use relatively simple passwords, which are relatively easy to remember, but also insecure. Forcing passwords to be forced through the system can be negatively evaluated by the users. Overall, user accounts on the Internet server can not be adequately protected using passwords.

It is an object of the invention to provide a solution, as in a method of the type mentioned the authentication of the user on the Internet server can be done very safe and without much effort for the user.

This object is achieved by a method and by a system having the features according to the respective independent claims. Advantageous embodiments of the invention are the subject of the dependent claims, the description and the figures.

An inventive method is used to enable remote control and / or remote monitoring of the operation of at least one Home appliance of a user using a separate from the household appliance communication device which communicates with an Internet server. The remote control and / or remote monitoring is done so by mediating the Internet server. A communication connection is established from the communication device to the internet server. The user then makes an authentication input to an input device of the communication device, wherein this authentication input is received by the communication device and transmitted to the Internet server. This authentication input is compared with data stored on the Internet server, and the user is authenticated depending on the comparison. After successful authentication, the remote control and / or remote monitoring is then performed. It is provided that at least one reference image of an interior space and / or a surrounding area of the household appliance is provided by means of a camera arranged on and / or in a domestic appliance of the user and at least one image region of the reference image - in particular the entire reference image - transmitted to the communication device and together is displayed with at least one further image on a display of the communication device, wherein the authentication input comprises the selection of one of the displayed images (ie, the at least one image region of the reference image or the at least one further image) by the user and the authentication is done depending on the selection.

According to the invention, it is thus provided that a plurality of images are displayed on the display of the communication device, one of which corresponds to a digital reference image or a partial region thereof, which shows the interior and / or surrounding area of one of the user's registered household appliances. This reference image is provided by means of a camera, which is arranged on and / or in the home appliance of the user. The user is prompted by the communication device to select one of the displayed images. The inventive method allows a very simple authentication only with a "click", which is also carried out particularly safe beyond. It is namely assumed that the content of the interior of the household appliance and / or its environment changes over time, which requires a constantly changing knowledge of the user. Namely, the user must know what is currently in the interior and / or surrounding area of his household appliance. The older the knowledge of this content is, the less chance there is that the correct reference image can be identified. With the method according to the invention, the user accounts can thus be secured particularly reliably and effectively.

In the present case, a communication device is understood to mean, in particular, a (personal) computer or a portable communication terminal, for example a mobile telephone, which is or is connected to the Internet and can thus communicate with the Internet server via the Internet. Via such a communication device, the user can log in by entering his authentication data on the personal user account and thus authenticate himself. The authentication input can be entered for example via an Internet portal of the Internet server. For this purpose, the user can use an Internet browser of the communication device. Additionally or alternatively, it is also possible to install a corresponding application or application on the communication device, which then communicates with the Internet server. Authentication then takes place via this application.

In the present case, a household appliance is understood to mean in particular a device which is used for household management. This may in particular be a large household appliance, such as a device for the care of laundry, a household appliance for food preparation, such as a cooking appliance, such as an oven or a stove, a household appliance for storing and preserving food, such as a household refrigerator, for example a refrigerator or a freezer or a fridge-freezer, an air conditioner or a dishwasher. A device for the care of laundry may be a washing machine, a tumble dryer or a washer-dryer.

As the at least one further image, in addition to the at least one image region of the reference image-in particular next to the entire reference image-an image of an interior and / or surrounding area of a domestic appliance of at least one other user or of at least one other user account can be displayed on the display of the communication device. It is then preferably provided that the successful authentication takes place only when the selected image corresponds to the reference image or an image region of the reference image. The remote control and / or remote monitoring is thus only possible if the selected image corresponds to the reference image or its subregion. In other words, access to the user account of the user is released only when the user selects the correct reference image of his own home appliance.

In one embodiment, it is further provided that in the reference image and the at least one other image of the other user household appliances of the same kind, in particular Household appliances of the same series, are shown. This further increases the security of the authentication, because it is not enough that the user knows his own household appliance. Rather, the user wishing to authenticate on the Internet server must also have the knowledge of the contents of the interior of his household appliance and / or the surrounding area of the household appliance. In the displayed images, the respective household appliances are preferably also represented from the same perspective or from the same viewpoint and with the same scaling. This also further improves the security of the authentication.

In addition or as an alternative to an image of another user, at least one image which was provided by means of the same camera at an earlier time than the reference image can also be displayed as the at least one further image. The reference image may be a current image of the household appliance, while the at least one other image may represent an "archive image" taken by the same camera at an earlier time. The successful authentication can only take place here if the selected image corresponds to the (current) reference image or an image region of the reference image. This also increases the security of authentication because the user must know the current contents of his household appliance or his current environment in order to successfully authenticate on the Internet server. An "old" knowledge is not enough here. In particular, a minimum age can be specified for the "archive images", from which these images can be displayed for selection. This ensures that the contents of the household appliance and / or the environment have changed sufficiently.

Furthermore, in addition or as an alternative, it can also be provided that at least one subregion of the same reference image is displayed as the at least one further image so that several, in particular different, subregions of the same reference image are displayed on the display of the communication device. The successful authentication can take place here only on condition that the selected image corresponds to a predetermined reference subregion of the reference image. For example, a partial region can be used as a reference partial region, in which a predetermined object - for example, last-added foods - is displayed. Here, an even more detailed knowledge of the user with regard to the content of the household appliance or its environment is required and the security thus further improved.

It proves to be particularly advantageous if in the reference image, an interior of a household appliance for storing and preserving food, especially a household refrigerator, such as a refrigerator, a freezer or a fridge-freezer, is displayed. In this embodiment, therefore, the user must have the knowledge of what foods are currently in his home appliance. This embodiment takes advantage of the fact that the contents of a refrigerator or freezer change relatively frequently over time. The knowledge of the content a week ago is usually only limited enough to reliably identify the current reference image. The security of authentication can thus be maximized. In order to be able to detect the interior of a refrigeration device, the camera can be, for example, a so-called night-vision camera or else a conventional digital camera, which additionally has an illumination device which is activated during image acquisition.

Preferably, the reference image is first transmitted from the camera to the Internet server. If the communication connection is then established by the communication device to the Internet server, then the reference image and the further images can be transmitted from the Internet server to the communication device. The management of the images is thus carried out by the Internet server. Thus, manipulation of data by unauthorized third parties can be prevented.

It is preferred if, prior to the transmission of the reference image to the communication device, data are removed from the reference image, which allow an association with the user's household appliance or unambiguously characterize the household appliance. The reference image provided by the camera is expediently provided with an identifier of the household appliance or the user prior to transmission to the Internet server, so that a clear assignment on the Internet server is possible. This identifier is then removed from the reference image before this reference image is transmitted from the Internet server to the communication device. These data may be, for example, meta / header data, such as Exif. This embodiment prevents manipulation of the reference image on the part of the communication device.

In one embodiment, it is provided that at least one reference object depicted in the reference image-for example a food item-is determined by the Internet server and / or the communication device, and the user's authentication input furthermore includes the selection of an object in the reference picture by the user. The successful authentication is then only under the condition that the selected object corresponds to the reference object. This can be implemented, for example, such that at first one of the displayed images is selected and, after selecting the correct reference image, the user is additionally requested to select an object imaged in the reference image.

However, the selection of the object can also take place simultaneously with the selection of the image, so that selection of the object automatically also makes the selection of the image in which the selected object is imaged. If this selected object corresponds to the reference object, the user is successfully authenticated. As the reference object, the last-added food and / or a favorite food can be determined. Such authentication is then particularly secure.

In addition, the user can specify an identifier of the user (identifier) via the authentication input. This allows a unique mapping of the authentication input to the user account of the user on the Internet server.

In order to always provide a current reference image on the Internet server, it can be provided that in each case a current reference image is transmitted from the camera to the Internet server at predetermined time intervals. The current reference image can then be displayed on the display of the communication device. This also helps to increase security in the authentication.

A system according to the invention comprises an Internet server and a communication device and is designed to carry out a method according to the invention.

Further features of the invention will become apparent from the claims, the figures and the description of the figures. All the features and feature combinations mentioned above in the description as well as the features and feature combinations mentioned below in the description of the figures and / or shown alone in the figures can be used not only in the respectively indicated combination but also in other combinations or alone.

The invention will now be described with reference to a preferred embodiment and with reference to the accompanying drawings.

Show it:

1 a schematic representation of a system according to an embodiment of the invention;

2 a flowchart of a method according to an embodiment of the invention; and

3 a schematic representation of a graphical user interface, which is displayed on a display of a communication device and via which an authentication input of a user is made.

An in 1 illustrated system 1 includes an internet server 2 which is connected to the internet 3 is connected. On the internet server 2 a variety of user accounts are performed, each of which is used for remote control and / or remote monitoring of the operation of household appliances. Through these user accounts, other functionalities can be provided to the topic of household appliances, such as help in case of malfunction, help for the use of household appliances and the like.

To the system 1 also includes a communication device 4 , which is formed in the embodiment as a portable communication terminal, such as a mobile phone. The communication device 4 has a display 5 on which a graphical user interface 6 can be generated. This can be provided for example by a corresponding application, which on the communication device 4 will be installed. the display 5 For example, a touch screen with a touch-sensitive surface 7 be. Also the communication device 4 is to the internet 3 connected, for example via a mobile network. The communication device 4 can thus with the Internet server 2 communicate.

In a household 8th There may be a variety of home appliances in total, including those in 1 only a household appliance 9 is represented representatively. In the embodiment, the household appliance 9 a fridge-freezer with a fridge 10 and a freezer 11 , The household appliance 9 has a camera 12 , by means of which images of an interior of the refrigerator 10 can be provided. The camera 12 may be, for example, a CCD camera or a CMOS camera. The household appliance 9 also includes a communication unit 13 about which the household appliance 9 to the internet 3 is connected, for example via a local (wireless) network of the household 8th ,

The camera 12 captures reference images of the interior of the refrigerator 10 and transmits the reference images to the Internet server 2 at predetermined intervals. The reference pictures can For example, every hour or every two hours or once a day to the Internet server 2 be transmitted.

The user of home appliances 9 who are in the household 8th located and on the internet server 2 are registered, can by means of the communication device 4 to his user account on the internet server 2 access the operation of household appliances through this user account 9 control and / or monitor. Lets the user access his user account on the internet server 2 is an authentication of the user on the Internet server 2 required. A method according to an embodiment of the invention will now be described with reference to FIG 2 explained in more detail. 2 shows a flowchart of the method, wherein on the left side steps are indicated by the communication device 4 are performed while on the right side steps are indicated by the internet server 2 be performed.

The method begins in a first step S1, in which the user activates, for example, the named application, which then displays the graphical user interface 6 on the display 5 generated. In a further step S2, the user gives to the communication device 4 For example, using the touch-sensitive surface 7 An identifier or an identifier, which of the communication device 4 to the internet server 2 is transmitted. The identifier is retrieved from the Internet server according to step S3 2 receive. The identifier may also already be in use on the communication device 4 be stored so that no explicit input by the user is required. The identifier does not need to be entered every time, so basically a one-click authentication is possible.

According to step S4, the Internet server checks 2 whether the identifier is correct or not. If the identifier is incorrect, because there is no user account for this identifier, for example, the access is rejected in step S5. If the identifier is correct, the process proceeds to a further step S6, in which by the Internet server 2 several pictures are selected.

On the one hand, these images comprise the current reference image of the interior of the refrigerator 10 of the user as well as several other images, in each of which the interior of an identical refrigerator is shown by other users. All pictures show the interior of refrigerators of the same series. In addition or as an alternative to the images of other users can through the Internet server 2 also pictures are selected, which by means of the same camera 12 at earlier times as the current reference image were provided, so "archive images". It is additionally or alternatively also possible to divide the reference image into several subregions and to define one of the subregions as the reference subregion.

From those through the internet server 2 selected images are thereby removed data that allow a technical mapping of images to the respective household appliances. These are, for example, meta / header data, such as Exif. The selected images are then sent to the communication device in the form of a message according to step S7 4 transmitted and on the display 5 the communication device 4 displayed in a further step S8.

An exemplary graphical user interface 6 with the pictures displayed is in 3 shown. How out 3 indicates includes the graphical user interface 6 an input field 14 via which the user can enter the above identifier. As mentioned, the identifier does not need to be entered every time, but may be permanently stored in the application. On the display 5 will also display the current reference image of the interior of the refrigerator 10 displayed in which 3 With 15 is designated. In addition to this reference picture 15 will also have more pictures 16 displayed from other user accounts and / or "archive images" of the same home appliance 9 represent. All pictures 15 . 16 show each the interior of a refrigerator of the same series and from the same perspective. The user is now prompted for one of the displayed images 15 . 16 select. For this, the user only needs one of the displayed images 15 . 16 over the touch-sensitive surface 7 to touch. Alternatively, it can also be provided that the selected image 15 . 16 is highlighted first and the user then another button 17 must touch to confirm this authentication input.

With renewed reference to 2 In step S9, an authentication input is made by the user in which one of the displayed images 15 . 16 is selected. The information about which picture 15 . 16 is selected, then to the Internet server 2 which checks in step S10 whether the selected image is the reference image 15 equivalent. Corresponds to the selected image of the reference image 15 , the process goes to a step S11 in which access to the user account is released. Does the selected image not match the reference image? 15 , the process proceeds to step S5, in which the access is rejected.

The successful authentication is therefore only if the selected image is the current reference image 15 equivalent.

In addition, it can also be provided that in the reference image 15 through the internet server 2 a reference object - such as food - is determined. After selecting the reference picture 15 by the user or at the same time as the selection of the reference image 15 (with a single "click"), the user can additionally be asked to, one of the in the reference image 15 to select the displayed objects. If the selected object then corresponds to the reference object, access to the user account can be granted. The reference object may be, for example, recently added foods and / or favorite foods. This embodiment can be implemented in particular if the entire reference image 15 is displayed without being divided into several separate subregions.

Become, however, several subregions of the reference image 15 displayed separately and thus independently selected for selection, the successful authentication can be made only on the assumption that the selected image of a predetermined reference subregion of the reference image 15 equivalent. For example, a partial region can also be used as the reference partial region, in which a predetermined object-for example, last-added foodstuffs-is depicted.

Downstream steps, such as the temporary certification of client and user by means of a valid token or the like, may also be implemented as needed.

LIST OF REFERENCE NUMBERS

1

 system

2

 Internet server

3

 Internet

4

 communicator

5

 display

6

 graphical user interface

7

 touch-sensitive surface

8th

 household

9

 household appliance

10

 fridge

11

 freezer

12

 camera

13

 communication unit

14

 input box

15

 reference image

16

 more pictures

17

 button

S1, S2, S3, S4, S5, S6, S7, S8, S9, S10, S11

 steps

Claims (12)

Method for enabling remote control and / or remote monitoring of the operation of at least one household appliance ( 9 ) of a user using one of the household appliance ( 9 ) separate communication device ( 4 ), which with an Internet server ( 2 ) communicates, comprising the steps of: - establishing a communication connection from the communication device ( 4 ) to the Internet server ( 2 ), Receiving an authentication input of the user by the communication device ( 4 ), wherein the authentication input by the user at an input device ( 5 ) of the communication device ( 4 ) and transmitting the authentication input from the communication device ( 4 ) to the Internet server ( 2 ), - comparing the transmitted authentication input with on the Internet server ( 2 ) and authentication of the user depending on the comparison and - enabling remote control and / or remote monitoring after successful authentication, characterized in that by means of a on and / or in a household appliance ( 9 ) of the user's camera ( 12 ) at least one reference image ( 15 ) of an interior space and / or a surrounding area of the household appliance ( 9 ) and at least one image region of the reference image ( 15 ) to the communication device ( 4 ) and together with at least one other image ( 16 ) on a display ( 5 ) of the communication device ( 4 ) is displayed, with authentication input selecting one of the displayed images ( 15 . 16 ) by the user and the authentication is done depending on the selection. Method according to claim 1, characterized in that as the at least one further image ( 16 ) at least one image of an interior and / or surrounding area of a household appliance ( 9 ) of another user and successful authentication only occurs when the selected image 15 ) or an image region of the reference image ( 15 ) corresponds. Method according to claim 2, characterized in that in the reference image ( 15 ) and the at least one image ( 16 ) of another user's home appliances ( 9 ) of the same kind, in particular household appliances ( 9 ) of the same series. Method according to one of the preceding claims, characterized in that as the at least one further image ( 16 ) at least one image is displayed, which by means of the same camera ( 12 ) earlier than the reference image ( 15 ), whereby the successful authentication takes place only if the selected image is the reference image ( 15 ) or an image region of the reference image ( 15 ) corresponds. Method according to one of the preceding claims, characterized in that as the at least one further image ( 16 ) at least a subregion of the same reference image ( 15 ) is displayed so that the display ( 5 ) several, in particular different, subregions of the reference image ( 15 ) and the successful authentication takes place only when the selected image of a predetermined reference subregion of the reference image ( 15 ) corresponds. Method according to one of the preceding claims, characterized in that in the reference image ( 15 ) an interior of a household appliance ( 9 ) for storing and preserving food, in particular a household refrigerating appliance ( 10 . 11 ) of the user. Method according to one of the preceding claims, characterized in that the at least one image region of the reference image ( 15 ) from the camera ( 12 ) to the Internet server ( 2 ) and from the Internet server ( 2 ) to the communication device ( 4 ) is transmitted. Method according to one of the preceding claims, characterized in that before transmitting the at least one image region of the reference image ( 15 ) to the communication device ( 4 ) Data from the at least one image region of the reference image ( 15 ), which are assigned to the household appliance ( 9 ) of the user. Method according to one of the preceding claims, characterized in that at least one in the reference image ( 15 ) imaged reference object by the Internet server ( 2 ) and / or the communication device ( 4 ) and the authentication input continues to select an object in the reference image ( 15 ), wherein the successful authentication occurs only when the selected object corresponds to the reference object. Method according to one of the preceding claims, characterized in that the authentication input additionally comprises an identifier (ID) of the user. Method according to one of the preceding claims, characterized in that at predetermined time intervals in each case at least one image region of a current reference image ( 15 ) from the camera ( 12 ) to the Internet server ( 2 ) and on the display ( 5 ) of the communication device ( 4 ) the at least one image region of the respective current reference image ( 15 ) is shown. System ( 1 ) with an Internet server ( 2 ) and a communication device ( 4 ), whereby the system ( 1 ) is adapted to perform a method according to any one of the preceding claims.

Images