FR3067561A1 - METHOD AND DEVICE FOR ASSISTING INTERACTION BETWEEN AN INDIVIDUAL AND AT LEAST ONE CONNECTED OBJECT - Google Patents

Abstract

The invention relates to a method of assisting the interaction between an individual and at least one connected object characterized in that it comprises steps of: - Receiving (11) at least a first data and second data from at least one first sensor, detecting the connected object from the first datum and the individual from the second datum, and determining a first one associated with the datum. connected object and a second profile for the individual, - In response to receiving (14) a first message from one of the connected object or the individual, called the sender, the broadcast ( 15) from a second message to the other of the connected object or the individual, called a receiver, the first message being in a format specified in the sender's profile and the second message being in a format specified in the profile of the receiver.

Description

Method and device for assisting the interaction between an individual and at least one connected object

The invention relates to the field of connected objects and, in particular, to interactions with connected objects.

The proliferation and emergence of new connected objects makes the world around us more and more complex both for the users, but also for the designers and manufacturers of these objects. The initialization and the use of these connected objects are often complex and too specific to a manufacturer, even to a product. This makes it difficult for users to manage and take advantage of the objects around them.

Current systems often require too much explicit user intervention. Communicating objects are centered on their own ecosystems so that the user has difficulty in appropriating them simply i5 and in a fluid manner.

Document US 20140351800 discloses a system configured to provide a user interface for establishing an application based on logic defined by a user executable on a mobile device. The system includes: a management module configured to provide the user

0 a means of defining a user-defined logical determination criterion, in which the user-defined logical determination criterion is based on an If-this-then-that rule, and to compile the application program in an executable format on the mobile device.

Such a system makes it possible to finely control the behavior of the mobile device in its environment. However, it requires strong programming skills.

The invention therefore aims to remedy the aforementioned problem in particular to simplify the configuration and configuration of connected objects and, in particular, their behavior during interactions with

0 other objects connected or with an individual.

To this end, it more specifically proposes a method for assisting the interaction between an individual and at least one connected object, characterized in that it comprises steps of:

- Reception of at least first data and second data from at least one first sensor,

- Detection of the connected object from the first datum and of individual 5 from the second datum,

- Determination of a first profile associated with the connected object and a second profile for the individual,

- In response to the reception of a first message from one of the connected object or from the individual, called the transmitter, the transmission of a second message to the other from the connected object or from the 'individual, called receiver, the first message being in a format specified in the profile of the sender and the second message being in a format specified in the profile of the receiver.

The method according to the invention makes it possible to associate individuals and i5 objects with dynamic virtual representations (profiles) capable of interacting with each other in ecosystems of connected objects.

The device analyzes a space using the data provided by the sensors and determines the occupants and the objects contained in this space. The device then associates these occupants and these objects with profiles, that is to say with virtual transpositions compatible with the ecosystems of heterogeneous connected objects to allow them to interact with each other.

Advantageously, the method according to the invention further comprises steps of:

- Reception of at least a third datum related to the individual,

- Update of the profile of the individual from the third data.

This characteristic allows the process to constantly adapt to changes in the environment and to refine the representation linked to an individual when new data is available.

Advantageously, the updated profile includes at least:

0 additional interaction methods. With this characteristic, the higher the recognition of an individual, the more interactions and authorizations will be important.

Advantageously, the determination of a first profile associated with the connected object and of a second profile for the individual comprises the determination of a level of confidence. This feature allows the process to work even if individuals or objects are not identified with certainty.

Advantageously, updating the profile of the individual from the third datum includes updating the confidence index. This characteristic allows the process to take into account the new data making it possible to improve the identification of an individual or an object.

Advantageously, the first sensor is able to collect data representative of a three-dimensional space, on the one hand, and data representative of the individual evolving in said three-dimensional space.

The invention also relates to a device for assisting in the interaction between an individual and at least one connected object, characterized in that it comprises:

Means for receiving at least first data and second data from at least one first sensor,

Means for detecting the connected object from the first datum and the individual from the second datum,

Means for determining a first profile associated with the connected object and a second profile for the individual,

Message reception and message transmission means, said message reception and message transmission means being configured for, in response to the reception of a first message from one of the connected object or of the individual, called the sender, send a second message to the other of the connected object or of the individual, called the receiver, the first message being in a format specified in the profile of the sender and the second message being in a format specified in the receiver profile.

Advantageously, the interaction aid device according to the invention further comprises means for updating the profile of the individual from a third datum coming from the sensor.

The invention also relates to a vehicle characterized in that it comprises a device according to the invention.

Other characteristics and advantages of the invention will appear on examining the detailed description below, and the attached drawings, in which:

- Figure 1 illustrates a flow diagram representing the method according to the invention; îo - Figure 2 illustrates an embodiment of a device according to the invention;

- Figure 3 shows an example of use of the device according to the invention.

The accompanying drawings may not only serve to complete the invention, but also contribute to its definition, if necessary.

With reference to FIG. 1, the method according to the invention comprises a step i5 for receiving 11 at least one first datum and second datum coming from at least one first sensor.

Referring to Figure 2, the device 20 according to the invention is connected to sensors 25 and / or to communicating objects 26 which will allow it to collect static and dynamic data on individuals and objects

0 contained in a three-dimensional space. The device 20 includes means 21 for receiving data from the sensors 25.

The data used to analyze the space can be combined and be of various natures.

A scanner can be used to obtain geometric data on space.

In the case where at least one of the sensors 25 is a camera, the analysis means advantageously comprise a facial recognition module configured to identify the individual present in the space.

0 If at least one of the sensors 25 is a wifi terminal, the analysis means advantageously comprise a module for determining a mac address of the at least one connected object present in space.

The method according to the invention also includes a step 12 of detecting an object connected from the first datum and an individual 31.33 from the second datum.

To this end, the device 20 according to the invention comprises means of detection 22 of at least one connected object and at least one individual.

From this data, the device 20 evaluates the occupants (i.e. the individuals) and the objects contained in this space with a view to associating them with a virtual representation (i.e. a profile).

The method according to the invention also includes a step of determining a first profile 13 associated with the connected object 32 and a second profile for the individual 31,33.

The device 20 according to the invention comprises means of association 23 between on the one hand an individual 31,33 or a connected object 32 and, on the other hand, a virtual representation (in other words a profile). The profile includes interaction methods defining how the object can communicate and / or interact with other entities with a profile. Interaction methods include event rules formulated for example in the form If-this-then-that (or If-this-then-that), APIs (for Application Programming Interface) or any other description allowed by these

0 connected object ecosystems.

For an individual 31,33, the profile specifies, for example, permissions granted to the individual 31,33 (for example, access to data or methods of interaction of other profiles).

According to a characteristic of the invention, the profile comprises predefined interaction methods, for example by a hardware supplier, for example with a published API making it possible to interact remotely with the object.

According to a characteristic of the invention, the profile includes interaction methods defined explicitly for example by a user

0 or implicitly by a learning mechanism, for example of the machine learning type, which anticipates future behaviors based on past interactions.

β

Advantageously, the step 13 of determining a first profile associated with the connected object and a second profile for the individual 31, 33 includes the determination of a confidence index.

The device 20 evaluates a confidence index of associations between virtual identity and objects or individuals, which allows it to operate in degraded mode with very little reliable information or, conversely, in authenticated mode when it can.

The confidence index of the association between an individual or an object and its representation depends in particular on the sensors available in space. The device 20 is able to combine all the information coming from the available sensors and other data such as that characterizing identified objects and individuals.

The actions and exchanges of information are adapted to the level of i5 trust of the association: thus sensitive data is only exchanged when the authentication of the objects or individuals involved is sufficiently strong.

The level of trust and the nature of relationships between individuals and objects can also change over time: for example, an occupant with

0 opaque glasses are first detected in three dimensions without being able to identify them, then facial recognition becomes possible when they take off their glasses. This level of trust is based on the identification of individuals and objects to be applied in associations and relationships between them.

Advantageously, the virtual representations (in other words, the profiles associated with the objects or with the individuals) are continuously updated according to the context.

To this end, the method further comprises steps of:

- Reception of at least a third data,

- Update of the profile of the individual 31.33 from the third datum.

In practice, the device 20 continuously receives data from the sensors. When one of the data allows, the determination (in other words the evaluation) of an object or an individual is updated or updated to complete the identification already carried out. As explained above, if initially an occupant with opaque glasses is first detected without being able to identify it then a facial recognition becomes possible when he takes off his glasses, then the profile associated with the individual is set to day accordingly.

Thanks to this characteristic, the same individual can successively be associated with several profiles: thus his virtual representation when he wears a connected golf watch coupled to his personal Smartphone assigns him a first profile which could trigger actions related to exercise of this sport, while the same individual not identified in space will be associated with a profile with very limited characteristics.

Advantageously, the device 20 further comprises means for the explicit identification of an individual, for example by voice command to confirm the association, or by a touch screen to choose a profile already known from a list or else again by explicit authentication on a Smartphone. This characteristic allows an individual to control the recognition carried out by the device by a self-declaration.

In addition, an individual can also choose to remain anonymous, which limits any exchange of data and any action. He may also want to remain "transparent" to the system, as can pets be to remote monitoring systems.

Advantageously, the method according to the invention further comprises a step of initializing the device 20, intended to improve the precision of the three-dimensional detection, based on data describing the geometry of the three-dimensional space. This step is not mandatory. This allows a precise definition of the reference space in three dimensions without occupants or objects: for example a car manufacturer can provide the data in three dimensions of the interior of a model or the architect that of a building.

Three-dimensional reference spaces can be confined like a room or the interior of a vehicle. But it is not compulsory. The device and method according to the invention also works with open spaces such as a tennis court where the limits are determined for example by the range of the sensors or the exchange of data with them. The limits can also change dynamically, for example if one of the sensors is mobile.

In an exemplary embodiment, the device 20 is connected to a sensor capable of collecting data representative of a three-dimensional space, on the one hand, and data representative of an animated form evolving in said three-dimensional space. This is for example a camera whose lens is oriented towards the interior of a passenger compartment of a vehicle.

It is also assumed that the individual is the driver of the vehicle and that the connected object is a connected bracelet worn by the driver.

FIG. 3 shows an example of use of the device according to the invention. The device 20 is able to interact with:

- A regular user 31 authenticated for example via an application on

Smartphone with an existing profile or with a history;

- A Smartphone 32 detected for example by mac address via a Wifi scan and associated for example by proximity to an occasional user;

- An occasional user 33, detected for example by three-dimensional scan or associated explicitly by himself with a profile;

- A connected house 34 in known association with the regular user and interacting via APIs;

- Other applications 35 associated with objects and interacting via APIs;

- A connected car 36, for example detected by geolocation and in known association with the regular user.

Claims (9)

1. Method for assisting in the interaction between an individual (31,33) and at least one connected object (32) characterized in that it comprises steps of: - Reception (11) of at least first data and second data from at least one first sensor (25), - Detection (12) of the connected object from the first datum and of the individual (31.33) from the second datum, - Determination (13) of a first profile associated with the connected object and of a second profile for the individual (31,33), - In response to the reception (14) of a first message from one of the connected object or from the individual (31,33), called the transmitter, the transmission (15) of a second message to the other of the connected object or of the individual (31,33), called receiver, the first message being in a format specified in the profile of the transmitter and the second message being in a format specified in the profile of the receiver. 2. Method according to claim 1, characterized in that it further comprises steps of: - Reception of at least a third datum related to the individual, - Update of the profile of the individual (31.33) from the third data. 3. Method according to one of the preceding claims, characterized in that the updated profile comprises at least: an additional interaction method. 4. Method according to one of the preceding claims, characterized in that the determination of a first profile associated with the connected object and of a second profile for the individual (31,33), comprises the determination of a level of confidence. 5. Method according to claims 2 and 4 taken in combination, characterized in that the updating of the profile of the individual (31.33) from the third datum includes an updating of the confidence index. 6. Method according to one of the preceding claims, characterized in that the first sensor is capable of collecting data representative of a three-dimensional space, on the one hand, and data representative of the individual (21,23 ) evolving in said space in three dimensions. 7. Device (20) for helping interaction between an individual (31,33) and at least one connected object (32) characterized in that it comprises: - Means for receiving (21) at least one first datum and second datum coming from at least one first sensor (25), 15 - Detection means (22) of the connected object from the first datum and of the individual (31.33) from the second datum, - Means for determining (23) a first profile associated with the connected object and a second profile for the individual (31,33), - Means for receiving a message (24) and sending a message (25), Said message reception (24) and message transmission (25) means being configured for, in response to reception of a first message from one of the connected object (32) or from the individual (31.33), called the transmitter, send a second message to the other from the connected object (32) or from the individual (31.33), called the receiver, the first 25 message being in a format specified in the profile of the sender and the second message being in a format specified in the profile of the receiver. 8. Interaction assistance device (20) according to the preceding claim, 3 0 characterized in that it further comprises means for updating the profile of the individual (31,33) from a third datum coming from the sensor. 9. Vehicle characterized in that it comprises a device according to one of claims 7 or 8.