FR3043828A1 - METHOD FOR MANAGING ACCESS TO DOMOTIC EQUIPMENT BY A REMOTE CONTROL TERMINAL - Google Patents

Abstract

Method for managing local home automation equipment by a remote control terminal, the method being characterized in that it comprises establishing an audio and / or video communication between the remote control terminal and a local control device adapted for locally controlling the home automation equipment, the following steps being implemented by the local control device during this communication: a) Transmission to the control terminal of a message comprising a list of home automation equipment with which the control terminal is authorized to interacting remotely during this communication, as well as the authorized interactions, or including information enabling said terminal to access this list and these interactions; b) Upon receipt of a request transmitted by the remote terminal for the control of at least one home automation device, control of said equipment.

Description

GENERAL TECHNICAL FIELD

The present invention relates to the field of domestic telepresence.

More specifically, it relates to a method of interaction with home automation equipment by a remote control terminal via a local control device.

STATE OF THE ART

The term telepresence refers to several techniques that allow a person to feel as if they are present, to appear to be present, or to have an effect in a place other than their actual location.

In general, current telepresence systems are based at best on videoconferencing solutions, allowing to see and communicate with the other party, in order to offer a remote communication and presence experience.

Telepresence devices designed for a home environment, such as Awabot's beam + robots, are known. This robotic telepresence system consists of a mobile platform and a visual and sound interface, allowing a remote user to control a robot from a computer and thus to give the user the opportunity to move about in a computer. a remote environment and communicate with people located in this environment.

Beyond the possibilities of videophone communication, it is shown that the feeling of presence in a remote environment when communicating with a speaker in the same environment, will be all the stronger, as the possibilities of actions offered in the remote environment will be important.

Thus, solutions such as robots + beam, allow the visualization of the local environment by the remote interlocutor through the movement of the robot in the environment. However, these solutions do not really offer an interaction "with" the remote environment of the interlocutor with whom we correspond.

It is thus desirable to improve the existing solutions so as to be able to offer interactivity solutions with the remote environment, the equipment that composes it, and thus enable a remote user to experience a more interactive telepresence experience at the same time as being fully secure. .

PRESENTATION OF THE INVENTION

An object of the invention is to propose a remote home automation equipment management method.

Another object of the invention is to provide a remote home automation equipment management method, which allows a remote user a more interactive telepresence experience.

Another object of the invention is to provide remote home automation equipment management that is fully secure.

In particular, according to a first aspect, the invention proposes a method for managing local home automation equipment by a remote control terminal, the method being characterized in that it comprises establishing an audio and / or video communication between the remote control terminal and a local control device adapted to locally control the home automation equipment, the following steps being implemented by the local control device during this communication: a) Transmission to the control terminal of a message: list of home automation equipment with which the control terminal is authorized to remotely interact during this communication, as well as authorized interactions, or • comprising information enabling said terminal to access this list and these interactions; b) Upon receipt of a request transmitted by the remote terminal for the control of at least one home automation device, control of said equipment.

Such a method allows a fully interactive experience since the control by the control terminal is in parallel with an audio and / or video communication.

In addition, it offers a strong security, since the remote control is done only when the audio and / or video communication is established and is in any case still controlled by a local control device.

Such a method is furthermore advantageously completed by the following different characteristics: the control device implements, prior to step a), at the start of the communication or before the establishment of said communication, a configuration processing of the list of home automation equipment with which the control terminal is allowed to interact remotely during the communication, as well as authorized interactions; the interaction authorizations are governed by rules based on a plurality of parameters, at least one parameter being chosen from the following list: name of the equipment, identifier of the control terminal and / or identity of the remote user and or zone of the local environment in which the home automation equipment is located and / or time and / or location of the control device and / or detection of external events by external sensors; the list of home automation equipment and authorized interactions is stored in a remote server that can be interrogated by the remote control terminal and by the local control device; during step a), the control device transmits to the control terminal an url address of said server; the control device transmits to the control terminal during step a) at least one key for the control of one of the home automation equipment, said device not controlling said equipment in step b) after verification that said key has been transmitted with the request; when controlling a device by the control device, said device transmits a signal notifying an interaction with said equipment; when the established communication is a video communication, the method further comprises: a step of image processing of the images of the video communication transmitted by the control device to the control terminal to recognize said home automation equipment and / or a label of identification affixed to said home automation equipment, control of said home automation equipment by the control device being authorized if said home automation equipment and / or said identification label is recognized in the transmitted images.

According to another aspect, the invention proposes a method for managing local home automation equipment by a remote control terminal, the method being characterized in that it comprises establishing an audio and / or video communication between the remote control terminal and a local control device adapted to locally control the home automation equipment, the following steps being implemented by the remote control terminal during this communication: a) Receipt of a list of home automation equipment with which the terminal of control is allowed to interact remotely during this communication; b) Display of interaction proposals for the user; c) After selection by the latter, transmission to the local control device of a request for the command by it of at least one of the home automation equipment.

The control terminal can in particular receive, during the communication, images of the local environment transmitted to it by the control device, said terminal implementing on these images processing for the recognition of the home automation equipment and / or identification labels affixed to them.

According to this particular embodiment of the invention, the control terminal is authorized to interact remotely on said at least one home automation equipment if said at least one home automation equipment and / or said identification tag affixed to said home automation equipment has been recognized in the local environment images transmitted by the control device. The invention furthermore relates to a device for controlling at least one home automation equipment, comprising: an audio and / or video communication interface with a control terminal; - A processing unit configured to implement the proposed method.

It also relates to a remote control terminal, comprising:

An audio and / or video communication interface with a local controller of at least one home automation equipment;

A processing unit configured to implement the proposed method.

It further relates to a computer program product comprising code instructions for executing the proposed method when said method is implemented by a microprocessor of the remote control terminal or the local controller.

PRESENTATION OF THE FIGURES Other features and advantages of the present invention will appear on reading the description which follows of a preferred embodiment. This description will be given with reference to the following figures: FIG. 1 diagrammatically represents a system for implementing the data processing method; FIG. 2 represents the main exchanges between the components of the system during an implementation of the method according to the invention; FIG. 3 represents an equipment recognition step by the control terminal. DETAILED DESCRIPTION System

FIG. 1 shows on the one hand a remote control terminal 10 and on the other hand a local environment, for example that of a home, in which there is a series of equipment 30 and a control device 20 The local equipment 30 and the local control device 20 form part of the same local network 50 and can exchange with each other by means of it.

The terminal 10 may be constituted by any type of device comprising a processing unit, as well as interface means: intelligent mobile terminal, touch pad, computer, game console, etc ... It allows a person who located outside the home to establish communication with the controller 20 which is at the local environment level. During this communication, the terminal 10 and the local control device 20 exchange information and instruction sequences; the control device 20 processes the information and commands transmitted by the terminal 10 and exchanges locally with the local equipment 30, for example to pass on some of the commands it receives from the terminal 10 (and therefore from the remote person).

Thus, the terminal 10 interacts with the different local equipments 30, but only through the local control device 20, when a communication is established between said terminal 10 and said device 20.

Therefore, the control of the equipment 30 is always local: the remote third party can not force a control of a device 30 that has not been previously authorized at the local control device 20.

In addition, the control terminal 10 can transmit instructions to the equipment 30 only when a communication is established, which supposes the presence of a person in the local environment to authorize its establishment.

The device 20 through which the various interactions between the remote terminal 10 and the local devices 30 pass comprises, in addition to a processing unit, various means allowing an interactive exchange between a person in the local environment in the vicinity of the device 20 and the device. a person being remotely, near the remote terminal 10: camera, screen, speakers, microphone, etc.

Said device 20 can be mobile in the local environment.

It is for example constituted by a telepresence robot, comprising on the one hand a support part, which is on wheels and which is motorized, and on the other hand an interactive tablet mounted on said support part. Said tablet can be independent of the robot and simply carried by it. It can alternatively be integrated with it, its microprocessor controlling the different movements of the robot.

The equipment 30 located in the home environment are of any type.

It may be home automation equipment such as household appliances (oven, hood, washing machine, dryer, etc.), or multimedia (television, stereo system, Bluetooth speaker, etc.) or more generally any type equipment that may be subject to remote control (lighting system, shutters, automated aquarium, etc.).

It may also be unconnected objects (a book, a poster, etc ...), not likely to communicate with the local control device 20, but offering however interaction possibilities for the local control device 20, or for the remote user and the remote terminal: recognition of the object in question, by the local device 20 or the terminal 10; initiating action proposals to the remote user when this object is detected by the terminal 10 or the device 20. Examples of this are described in more detail below.

The home automation devices 30 are connected to the local network 50 via a gateway, for example an IAD ("Integrated Access Device" according to the English generally used terminology). The connection to the gateway can be via an Ethernet link or a wireless link, such as a communication protocol governed by IEEE 802.11 standards such as Wi-Fi.

The gateway can also provide the connection of the control device 20 to an external communication network 40, to which the remote control terminal 10 can itself connect. The communication between the control device 20 and the terminal 10 is established via this network 40.

The equipment 30 can also be connected directly to the control device 20 via an Ethernet link, or by radio waves by wireless communication protocols such as NFC, Wi-Fi, ZigBee, Bluetooth, etc.

Method of managing access to equipment

With reference to FIG. 2, the establishment of a call 220 can be done: on the initiative of a remote user provided with a remote control terminal 10 to the local control device 20, or at the initiative of the local controller 20.

The communication is an audio and / or video communication.

In both cases, a user located in the local environment intervenes on the device 20 to validate the establishment of the communication or launch it, so that the remote control by the terminal 10 can not be done without the presence a user at the local environment level.

After the establishment 220 of the communication, the local controller 20 and the remote control terminal 10 exchange a certain amount of information (step 230).

In particular, for example, the terminal 10 identifies itself and, where appropriate, identifies the remote user at the control device.

After identification, it receives from the local control device 20 a list of devices 30 with which the remote user is authorized to interact via said control terminal 10 and said local control device 20. On reception, the remote control terminal 10 stores this list and the associated information (step 240).

The equipment list 30 and the interaction authorizations are managed by the local controller 20 according to configurations entered on it by one or more local users with administrative rights. Other parameters than the identity of the remote user and / or the identification of the terminal 10 can be taken into account for the configuration of the list, such as the area of the local environment in which the equipment 30 is where the local user wants to order it. Thus, it can be decided that this or that equipment (portable stereo, etc.) will not be ordered when it is in certain rooms of the home. Also, access to certain equipment may be offered to some remote users and not to others depending on the time of day. Of course, remote interaction configurations can be more complex and combine conditions on multiple parameters. In addition, other parameters can be envisaged: identity of the user of the local control device, location of the control device 20, external events (alarm, weather, ...) detected by sensors communicating with the device of the control device. order 20, etc ...

Interaction authorizations may be entered or updated in the controller 20 by the local user at the start of communication with the remote terminal 10. The accessibility to the equipment 30 may also be previously configured outside of the control device 20. communication between the controller 20 and a terminal 10 (step 210); the configuration can in this case also be done outside the control device 20, through a web interface or a specific application installed on a terminal other than the control device 20; this accessibility configuration can also be modified during communication by the local user interacting on the control device 20 (step 210 ').

In a variant, when the communication established between the control terminal and the control device is a video communication, the equipment accessibility configuration can be updated during the communication when a home automation device enters the capture field. video of the control device and is therefore visible to a user of the control terminal. According to this variant, an interaction on a home automation device is only allowed if this home automation equipment is recognized in the video communication images, for example according to an object recognition method as described below in relation to FIG. Such a method can be implemented by the control device or by the control terminal.

Thus, the system allows dynamic management of access to equipment.

The list of local equipment and all or part of the configuration information may further be stored on a remote server 70 (FIG. 1) that can be interrogated by the control device 20, and if necessary by the terminal 10, to each institution of new communication.

In this mode of implementation, the local control device 20 can, at the establishment of the communication and after identification of the terminal 10, transmit to it a url of the web server to retrieve this information,

The control terminal 10 then interrogates (step 241) the server 70 to retrieve the information pointed by the url. The server 70 transmits said information to the control terminal 10 which stores them (step 242).

The equipment list can for example be represented under the following structure:

Name (ex: washing machine 1)

Location (ex: Bathroom ground floor)

Reference (ex: INDBLCk126732FR)

Recognition

Image 1 (ex: image of the washing machine)

Image 2 (ex: QRcode associated with the washing machine)

Image n

Action 1

Name (eg launch short cycle)

Symbol (eg short cycle pictogram)

Action 2

Name (ex: spin spin)

Symbol

Action n

Last name

Symbol

Sound (activate a sound signal when activating the equipment)

His "On"

Its "Off" It is for example in this format that the list of equipment likely to interact with the control terminal 10 and the associated information are stored in the terminal 10 during step 240.

The terminal 10 then proposes to the remote user (on-screen display for example) a list of equipment 30 and the available interactions.

In one possible embodiment (FIG. 3), the local control device 20 comprises an image sensor, while the remote control terminal 10 has a display screen 320 and a processing module. image 330 associated with an object recognition base 340 integrated with said terminal 10. This base 340 is itself powered by information (vector representations associated with equipment 30 for example) transmitted by the server 70 or the device 20 with the list of available equipment 30.

Thus, during a videoconference type call, the home environment is filmed by the local control device 20 and relayed to the control terminal 10. The image of the home 310 is thus broadcast on the display screen 320 of the control terminal 10. An available equipment 30, filmed by the local control device 20, will be recognized by the image processing module 330, associated with the base 340 of the remote control terminal 10.

The image processing module 330 then highlights the recognized equipment 321 on the display screen 320 of the control terminal 10, for example by displaying it highlighted with a message indicating the possible actions.

Alternatively, identification labels 311 may be affixed to some of the equipment 30. These labels 311 bear a visual identification code (identification number, or code or visual cryptogram, such as for example a barcode, QRCode or Datamatrix), intended to be recognized by the image processing module 330, associated with the base 340. The base 340 memorizes itself these identification codes which are transmitted to it by the server 70 or the device 20 with the list of the equipments. 30 available. When the control device 20 films one of its labels 311, the image is transmitted to the remote control terminal 10 and the label is recognized by the image processing module 330 and the base 340. image 330 then highlights the recognized equipment 321 on the display screen of the control terminal 320.

According to another particular embodiment of the invention, such an equipment recognition method or label can be implemented by the control device. The control device then transmits such information to the control terminal so that it highlights the equipment recognized on the display screen of the control terminal. Such information may correspond to an update information of the interaction permissions of said recognized equipment. Thus, the user of the control terminal will have the ability to interact on the equipment only if the equipment is in the video capture field of the control device.

When he wishes to interact with a device 30, the remote user selects a proposal for equipment and action on the terminal 10, which generates a request for the local control device 20 (step 260).

The receipt of this request by the local controller 20 will produce the generation therefrom of a control signal 20 to the selected equipment 30 (step 270).

When sending a command signal, the local controller 20 may notify the sending of this command. This notification can take the form, for example of a sound signal specific to the command sent. Thus a person present in the local environment, can be informed of the order of equipment. Step 290 corresponds to the end of the communication initiated by the terminal or the control device.

In an implementation variant, the request sent by the terminal 10 integrates an authentication key which is verified by the local control device 20 before sending a control signal to the equipment in step 270 .

This key, specific to each equipment, has previously been transmitted to the terminal 10 by the control device 20 at the beginning of communication. The remote user can thus access only the equipment to which the local control device 20, gave him access for a given communication.

As noted above, the interactions may also involve unconnected equipment. The recognition of this type of equipment by the remote control terminal 10, can cause an interaction at said terminal. For example, a book cover filmed by the local control device 20 may be recognized by the control terminal 10, which will make it possible to offer the purchase by internet to the remote user, or to display at the terminal the corresponding digital book to allow remote reading of this book, etc ...

Claims (14)

1. Method for managing local home automation equipment by a remote control terminal, the method being characterized in that it comprises establishing an audio and / or video communication between the remote control terminal and a control device local device adapted to locally control the home automation equipment, the following steps being implemented by the local control device during this communication: a) Transmission to the control terminal of a message comprising a list of the home automation equipment with which the control terminal is authorized to interact remotely during this communication, as well as authorized interactions, or including information enabling said terminal to access this list and these interactions; b) Upon receipt of a request transmitted by the remote terminal for the control of at least one home automation device, control of said equipment. 2. Method according to claim 1, wherein the control device implements, prior to step a), at the start of the communication or before the establishment of said communication, configuration processing of the list of home automation equipment. with which the control terminal is allowed to interact remotely during the communication, as well as authorized interactions. 3. Method according to one of the preceding claims, wherein the interaction permissions are governed by rules based on a plurality of parameters, at least one parameter being chosen from the following list: name of the equipment, identifier of the control terminal and / or identity of the remote user and / or zone of the local environment in which the home automation equipment is located and / or time and / or location of the control device and / or detection of external events by external sensors. A method according to any one of the preceding claims, wherein, when the established communication is a video communication, the method further comprises: a step of image processing of the video communication images transmitted by the controller at the control terminal for recognizing said home automation equipment and / or an identification label affixed to said home automation equipment, • the control of said home automation equipment by the control device being authorized if said home automation equipment and / or said identification label is recognized in the transmitted images. 5. Method according to one of the preceding claims, characterized in that the list of home automation equipment and authorized interactions is stored in a remote server capable of being interrogated by the remote control terminal and by the local control device. 6. The method of claim 5, wherein, in step a), the control device transmits to the control terminal an url address of said server. 7. Method according to one of the preceding claims, wherein the control device transmits to the control terminal during step a) at least one key for the control of one of the home automation equipment, said device not controlling said equipment in step b) after verification that said key has been transmitted with the request. 8. Method according to one of the preceding claims, wherein during the control of a device by the control device, said device emits a signal notifying an interaction with said equipment. 9. Method for managing local home automation equipment by a remote control terminal, the method being characterized in that it comprises establishing an audio and / or video communication between the remote control terminal and a control device. local adapted to locally control the home automation equipment, the following steps being implemented by the remote control terminal during this communication: a) Receipt of a list of home automation equipment with which the control terminal is authorized to interact remotely during this communication; b) Display of interaction proposals for the user; c) After selection by the latter, transmission to the local control device of a request for the command by it of at least one of the home automation equipment. The method according to claim 9, wherein the control terminal receives, during the communication, images of the local environment transmitted to it by the control device, said terminal implementing on them an image processing for the recognition of home automation equipment and / or identification labels affixed thereto. 11. The method of claim 10, wherein the control terminal is authorized to remotely interact on said at least one home automation equipment if said at least one home automation equipment and / or said identification tag affixed to said home automation equipment has been recognized. in the images of the local environment transmitted by the control device. A device for controlling at least one home automation equipment, comprising: an audio and / or video communication interface with a control terminal; A processing unit configured to implement the method according to one of claims 1 to 8. A remote control terminal, comprising: an audio and / or video communication interface with a local controller of at least one home automation equipment; A processing unit configured to implement the method according to one of claims 9 to 11. A computer program product comprising code instructions for executing a method according to one of claims 1 to 11 when said method is implemented by a microprocessor of the remote control terminal or the local controller. .