EP4010785A1 - Kommunikationsaufbau durch analyse von augenbewegungen - Google Patents

Kommunikationsaufbau durch analyse von augenbewegungen

Info

Publication number
EP4010785A1
EP4010785A1 EP20820480.0A EP20820480A EP4010785A1 EP 4010785 A1 EP4010785 A1 EP 4010785A1 EP 20820480 A EP20820480 A EP 20820480A EP 4010785 A1 EP4010785 A1 EP 4010785A1
Authority
EP
European Patent Office
Prior art keywords
terminal
user
eye movements
communication
message
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20820480.0A
Other languages
English (en)
French (fr)
Inventor
Jean CARTIGNY
Thomas MAHERAULT
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Orange SA
Original Assignee
Orange SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Orange SA filed Critical Orange SA
Publication of EP4010785A1 publication Critical patent/EP4010785A1/de
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/26Devices for calling a subscriber
    • H04M1/27Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • H04M1/27467Methods of retrieving data
    • H04M1/2747Scrolling on a display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup
    • H04W76/11Allocation or use of connection identifiers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/52Details of telephonic subscriber devices including functional features of a camera

Definitions

  • the invention relates to the field of telecommunications and relates more particularly to a method for initiating and / or maintaining communication by analyzing eye movements.
  • terminals occupies a large part of the time of their owners because the uses are very varied: internet, communications, agenda, reading, photo, video, television, games, ...
  • the terminals must offer a particularly efficient interface so that users do not waste time in technical manipulations and that useful information is immediately available. They should also help, to the extent possible, in the ownership of these services by all users by providing tools for accessibility.
  • the invention improves the state of the art by exploiting oculometry systems (in English Eye-tracking) which bring together a set of techniques for recording and analyzing a person's eye movements.
  • oculometry systems in English Eye-tracking
  • Most common eye trackers analyze images of the human eye captured by a camera, often in infrared light, to calculate and determine the direction of gaze.
  • a method for establishing a communication intended for at least one terminal of at least one second user by analyzing the eye movements of a first user said method being implemented by a device for 'establishment of a communication by analysis of the eye movements of said first user, said device having at least one camera and at least one area of interest associated via an identification datum with said at least one terminal of said at least one second user, and characterized in that the method comprises:
  • the method makes it possible to limit the physical interactions with the device.
  • This allows for example a disabled user who does not have ability or limited ability to grasp, to establish communication with, for example, an emergency department, a doctor or a loved one.
  • a worker in the industry or a surgeon performing for the needs of their work tasks requiring the exclusive use of their arms and / or their hands, can establish a communication with for example a conversational assistant, a supervisor or a colleague in order to obtain, for example, information on an intervention protocol or to make an emergency call.
  • Communication can be established, for example, when the user stares at a button, a screen, an item displayed on a screen, a light-emitting diode, or any other part of the device for a given period of time.
  • terminals and more particularly screens are vectors of microbes and bacteria.
  • such a method makes it possible to dispense with the language used / configured on the device and its written transcription.
  • the user does not need to speak a command aloud or know how to read the menus displayed in a particular language. He adjusts need to rest his gaze for a given period of time on all or part of the device.
  • area of interest is meant all or part of the determined device and allowing an identifier of the user and / or of his terminal to be associated with it in order to establish communication with it.
  • message any message allowing communication with the terminal such as SMS / MMS, signaling messages allowing for example the initialization of telephone / videophone communications via an IP network or circuit, instant messaging including status notifications, emails or any other message making it possible to exchange information between the device and the terminal via a telecommunications channel, such as for example a telecommunications network or a direct Bluetooth / WiFi point-to-point link.
  • a telecommunications channel such as for example a telecommunications network or a direct Bluetooth / WiFi point-to-point link.
  • a method as described above is characterized in that the transmission step is followed by the following steps:
  • this embodiment allows the user, in the event that the third message is an end of communication message, to maintain communication with his interlocutor as long as his gaze remains directed to the area of interest.
  • the third message can also be a message allowing the transmission of data such as text, photos / videos or even a communication status.
  • a method as described above is characterized in that said at least a first message is a message requesting the establishment of a bidirectional communication between said device and said at least one terminal.
  • this embodiment allows the establishment of a bidirectional communication between the device and the terminal in order to have a real-time exchange between the first and the second user.
  • the two-way communication can be, for example, voice, videophone or text communication.
  • a method as described above is characterized in that the transmission step is followed by the following steps:
  • This embodiment of the invention allows the user of the device to validate the establishment of a communication between the device and the terminal and thus to ensure that the user of the device wishes to establish communication with the device. terminal user. Validation can also be done automatically by the device according to rules defined by the user such as date, time, called party, etc.
  • a method as described above is characterized in that the area of interest is at least part of a screen.
  • This embodiment of the invention makes it possible, for example, to contextualize the display by dividing the screen into several areas of interest, and consequently to establish communications with different interlocutors.
  • This can for example be phone numbers displayed through a browser, for example in the form of hypertext links.
  • the area of interest can take up the entire screen.
  • the method as described above is characterized in that the area of interest is a contact sheet associated with said at least one second user.
  • This embodiment of the invention makes it possible, for example, to ensure that the establishment of the communication will only be possible when the user is located in the tree structure of the man-machine interface of the device at the level of the contact card of the called party and thus prevent any unwanted communications.
  • a method as described above is characterized in that said duration is reproduced on the device via a progress bar.
  • This embodiment of the invention makes it possible to give visual feedback to P user on the state of progress of the process and of the delay or threshold for triggering the sending of the message to the called party.
  • this threshold can be configured and set by the user himself.
  • This rendering can also be done through two displays. The first at the start and the second at the end of the time interval corresponding to the length of time that the user's gaze remains focused on the area of interest. This could for example be a light emitting diode that flashes at the start and end of the time interval, or an icon that changes color at the end of the time.
  • a method as described above is characterized in that said duration is reproduced on the device via sound or vibration.
  • This mode of implementation of the invention allows feedback to the user on the progress of the process and the delay or trigger threshold for sending the message to the called party.
  • this threshold can be configured and set by the user himself.
  • the user can also set the sound volume, an audio sequence or a vibration sequence, or even define a sound or vibration intensity ranging, for example, to crescendo.
  • the restitution of the duration can also be done thanks to two audio sequences or two sequences of vibrations, the first at the beginning and the second at the end of the time interval corresponding to the duration during which the gaze of the user remains directed. on the area of interest.
  • a method as described above is characterized in that the transmission step is preceded by a validation step on the device by the first user.
  • this mode of implementation allows the user to validate or cancel the sending of the communication establishment message.
  • This action can for example be done thanks to a particular movement of the eyes, a head movement, voice command, pressing a hardware or software button, or any other interaction with the device's human-machine interface.
  • the invention also relates to a method of communication between a first terminal of a first user and a second terminal of a second user each comprising a device for establishing a communication to at least one terminal by analysis of movements.
  • eyepieces of a user said terminals having at least respectively a first and a second camera and at least respectively a first and a second zone of interest associated respectively with the second and with the first terminal, and characterized in that the method comprises:
  • a step of evaluation by said first terminal of a first duration during which the analysis of the eye movements indicates that the gaze of the user of the first terminal remains directed towards said first zone of interest, and when the evaluation indicates that this duration is greater than a first threshold, a step of transmission by said first terminal of at least one first message to said at least one second terminal,
  • a step of evaluation by said second terminal of a second duration during which the analysis of the eye movements indicates that the gaze of the user of the second terminal remains directed towards said second area of interest, and when the evaluation indicates that this second duration is greater than a second threshold, a step of transmission by said second terminal of at least one second message to said at least one first terminal,
  • This embodiment of the invention makes it possible to trigger an informal communication remotely and spontaneously.
  • two users look at the other's contact card simultaneously on their device, for example, a negotiation is established between the two devices. If they maintain eye contact for a period of time then communication is initiated naturally between the two users. This makes it possible, for example, to ensure the availability of his interlocutor before transmitting a call request and to limit call rejection.
  • the method as described above is characterized in that the transmission step carried out on said first terminal is followed by a restitution step on said first terminal d a second delay materializing said time interval during which the reception of said at least one second message by said first terminal allows the establishment of the communication.
  • this mode of implementation makes it possible to provide the user with an indication of the time period during which communication with the remote terminal will be possible. After this time, the user will be informed that the attempt to establish communication has failed.
  • the delay can be reproduced, for example, by means of vibrations, sounds, or a dedicated display.
  • the invention also relates to a device for establishing a communication to at least one terminal of at least one second user by analyzing the eye movements of a first user, said device having at least one camera and at least an area of interest associated via identification data with said at least one terminal of said second user, and characterized in that the device comprises:
  • a transmission / reception module allowing the transmission of at least a first message to said at least one terminal identified by said identification datum, a module for analyzing the eye movements of said first user captured by said camera,
  • an evaluation module for a period during which the analysis of eye movements indicates that the gaze of the first user remains focused on said area of interest.
  • module can correspond both to a software component and to a hardware component or a set of hardware and software components, a software component itself corresponding to one or more computer programs or subroutines or more generally. to any element of a program capable of implementing a function or a set of functions as described for the modules concerned.
  • a hardware component corresponds to any element of a hardware set (or hardware) capable of implementing a function or a set of functions for the module concerned (integrated circuit, smart card, memory card, etc. .).
  • the invention also relates to a terminal characterized in that it comprises a device for establishing a communication as described above.
  • the invention also relates to a communication system between a first and a second terminal, the terminals respectively comprising a device for establishing a communication as described above, characterized in that the module for transmitting / receiving the first terminal also allows the reception of at least one second message transmitted by said second terminal and the establishment of a communication to said second terminal.
  • the invention also relates to a system for establishing a communication to at least one terminal of at least one second user by analyzing the eye movements of a first user, said system having at least one camera and at least an area of interest associated via identification data with said at least one terminal of said second user, and characterized in that the system comprises:
  • a first device comprising means for establishing a communication
  • a second device comprising means for analyzing eye movements captured by said camera
  • a third device comprising means for evaluating the duration during which the analysis of the eye movements indicates that the gaze of said first user remains directed on said area of interest, the devices being arranged so that when the evaluation indicates that said duration is greater than a threshold, this triggers the sending of a message from said first device to said at least one terminal identified via said identification datum.
  • the invention also relates to a computer program comprising instructions for implementing any of the above methods according to any one of the particular embodiments described above, when said program is executed by a processor.
  • the method can be implemented in various ways, in particular in wired form or in software form.
  • This program can use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other. desirable shape.
  • the invention also relates to a recording medium or information medium readable by a computer, and comprising instructions of a computer program as mentioned above.
  • the recording media mentioned above can be any entity or device capable of storing the program.
  • the medium may include a storage means, such as a ROM, for example a CD ROM or a microelectronic circuit ROM, or else a magnetic recording means, for example a hard disk.
  • the recording media can correspond to a transmissible medium such as an electrical or optical signal, which can be carried via an electrical or optical cable, by radio or by other means.
  • the programs according to the invention can in particular be downloaded from an Internet type network.
  • the recording media can correspond to an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the method in question.
  • This device for establishing a communication to a terminal by analyzing the eye movements of a user and this computer program have characteristics and advantages similar to those described above in relation to the method for establishing a user. communication to a terminal by analyzing the eye movements of a user.
  • Figure 1 illustrates an example of an environment for implementing the invention according to a particular embodiment of the invention
  • FIG. 2 illustrates an example of display on a device suitable for implementing the method of establishing a communication to at least one terminal by analyzing the eye movements of a user, according to a particular embodiment of the invention
  • FIG. 3 illustrates the architecture of a device suitable for implementing the method of establishing a communication to at least one terminal by analyzing the eye movements of a user, according to a particular embodiment of the invention
  • Figure 4 illustrates the main steps of the process for establishing a communication to at least one terminal by analyzing the eye movements of a user according to a particular embodiment of the invention.
  • FIG. 5 illustrates the main steps of the process for establishing a communication to at least one terminal by analyzing the eye movements of a user according to a second particular embodiment of the invention.
  • FIG. 1 illustrates an example of an environment for implementing the invention according to a particular embodiment.
  • the environment shown in figure 1 comprises a terminal 100 implementing the device and the method according to the present invention.
  • the terminal 100 integrates the device for establishing a communication.
  • the device for establishing a communication may be located in the network and / or distributed over one or more computer machines such as computers, terminals or servers.
  • the terminal 100 is for example a terminal of the smartphone type, a tablet, a television connected to a communication network, a connected object, an autonomous car, a personal computer or any other terminal having a camera and allowing establish electronic communications.
  • the terminal 100 is a smartphone having a camera (102) and adapted to display on its screen a list of contacts (101) with which are associated for example telephone numbers, e-mail addresses, pseudonyms. or any other data making it possible to reach and / or communicate with the contacts in the list, for example by means of SMS / MMS, telephone / videophone calls, instant messages, e-mails etc.
  • the list of contacts can be stored on the terminal or be accessible from the network.
  • the method can operate permanently and autonomously on the device integrated in the terminal as soon as the terminal 100 is activated or else following a user action or even during time slots determined by the user. As soon as the process is operational, the analysis of the eye movements of the users present in the field of view of the camera begins.
  • the environment shown in FIG. 1 also includes a user (103) who can interact with the terminal 100.
  • the camera of the terminal 100 captures the user's eye movements when the latter is in his field of detection.
  • the captured data is then processed and analyzed by the terminal 100.
  • the terminal detects it and for example starts a stopwatch. or a counter in order to evaluate the duration during which the gaze of the user remains directed on the item “Alice”. If the duration is greater than a threshold, then a communication is initiated to Alice.
  • the stopwatch is reset and starts again from zero.
  • the communication then initiated can be of any type such as for example telephone, videophone, SMS / MMS, text, data transfer, etc.
  • the terminal 100 when the threshold is reached, the terminal 100 sends a communication request message to Alice (ie its terminals). Alice can then send a message in return indicating that a two-way communication such as a telephone or videophone can be established.
  • Alice can then send a message in return indicating that a two-way communication such as a telephone or videophone can be established.
  • the user of the terminal 100 will have the possibility to validate or not the establishment of the communication. This validation can be done at the level of the terminal 100 via a man-machine interface such as a graphical interface, a voice command, or else automatically according to rules predefined by the user such as date, time, etc. the called party, etc.
  • a validation step on the part of the user may be necessary before the communication is initiated to Alice.
  • This validation can be done at the level of the terminal 100 via a human-machine interface such as a graphical interface, a voice command, or else automatically according to rules predefined by the user such as date, time, etc. the called party, etc.
  • the zone to be set by the user to trigger the establishment of the communication can be all or part of the device integrated into the terminal 100.
  • This can be a constituent physical element of the terminal such as for example the camera, a light-emitting diode, a button or a pop-up area of the screen.
  • the threshold value can be configured by the user depending on the uses, the user interface such as the depth level in a tree structure or a time or a date.
  • FIG. 2 illustrates an example of a display restored by the terminal 100, of the method for establishing a communication intended for at least one terminal by analyzing the eye movements of a user in connection with the environment illustrated by figure 1.
  • the stopwatch starts and a progress bar (202) is displayed and indicates the progress and / or the percentage of progress of the value of the stopwatch compared to the threshold value to be reached allowing the establishment of communication.
  • the stopwatch reaches the threshold value, for example 5 seconds, the progress bar is then complete and communication to Alice is established.
  • the progress bar is for example displayed superimposed on the item "Alice” but can be displayed in any form making it possible to illustrate the progress of the stopwatch and at any place on the human-machine interface visible to the user and displayed by the terminal.
  • the user feedback on the progress of the stopwatch can also be done by means of sounds.
  • sounds When the user stares at the "Alice" item in the contact list, a sound is emitted by the device to indicate that the stopwatch is starting.
  • the stopwatch reaches the threshold value, for example 5 seconds, a new sound is then played to indicate that communication with Alice is being established.
  • the sounds may vary in duration, intensity or change tone depending on the context, for example the contact selected by the user's gaze. If the user looks away from the "Alice" item before the second sound is played and therefore the stopwatch reaches the threshold value, then the stopwatch starts over.
  • User feedback can also be achieved by means of a sound played continuously over the period during which the user's gaze remains directed to the “Alice” item.
  • the sound is then emitted by the device when the chronometer is started and stops when the chronometer reaches the threshold value, indicating the establishment of communication to Alice. During this time the sound may vary in intensity or change in tone. If the user looks away from the “Alice” item before the sound stops and therefore that the chronometer does not reach the threshold value then the chronometer starts again from zero.
  • the user feedback on the progress of the chronometer can also be done by means of vibrations.
  • a vibration is emitted by the device to indicate that the stopwatch is starting.
  • the stopwatch reaches the threshold value, for example 5 seconds, a new vibration is then emitted to indicate that the establishment of communication with Alice is taking place.
  • the vibrations may vary in duration and / or intensity depending on the context, for example the contact selected by the user's gaze. If the user looks away from the "Alice” item before the second vibration is played and therefore the stopwatch reaches the threshold value, then the stopwatch starts over.
  • User feedback can also be achieved through a vibration played continuously over the period during which the user's gaze remains focused on the "Alice” item.
  • the vibration is then emitted by the device when the stopwatch is started and stops when the stopwatch reaches the threshold value, indicating the establishment of communication with Alice. During this time the vibration may vary in intensity. If the user looks away from the "Alice” item before the vibration stops and therefore the stopwatch reaches the threshold value, then the stopwatch starts over.
  • Alice has a similar terminal, including a device for establishing a communication to at least one terminal by analyzing the eye movements of a user according to one embodiment of the invention.
  • another timer can be initialized on the user's device, to indicate the time during which Alice can respond favorably to her call request.
  • FIG. 3 illustrates a device 300 configured to implement the method for establishing a communication intended for at least one terminal by analyzing the eye movements of a user according to a particular embodiment of the invention.
  • the device 300 has the classic architecture of a telephone mobile, of smartphone type, and comprises in particular a memory MEM, a processing unit UT, equipped for example with a processor PROC, and controlled by the computer program PG stored in memory MEM.
  • the computer program PG comprises instructions for implementing the steps of the method of establishing a communication intended for at least one terminal by analyzing the eye movements of a user as described above, when the program is executed by the PROC processor.
  • the code instructions of the computer program PG are for example loaded into a memory before being executed by the processor PROC.
  • the processor PROC of the processing unit UT notably implements the steps of the method of establishing a communication intended for at least one terminal by analyzing the eye movements of a user according to any one of the particular modes. embodiments described in relation to Figures 1 and 2, according to the instructions of the computer program PG.
  • Device 300 includes a COM communication module configured to establish communications with an IP network and / or circuit. It also includes a camera (CAM) to capture eye movements. The captured eye movements are then analyzed by the CALC module. This module makes it possible for example to determine whether the user's gaze is directed towards an area of interest located on the device. Note that it is possible for the analysis step to be preceded by a recording step making it possible to record the eye movements in the memory MEM of the device. The eye movement analysis is then transmitted to the DETX module which will determine whether the user's gaze remains directed to an area of interest of the device for a period greater than a threshold value. For this it has a stopwatch or a counter that it will start as soon as the user's gaze is directed to an area of interest.
  • a threshold value For this it has a stopwatch or a counter that it will start as soon as the user's gaze is directed to an area of interest.
  • the device for establishing a communication to at least one terminal by analyzing the eye movements of a user comprises a display module (DISP) such as for example a screen suitable for displaying data for establishing communications through the COM module.
  • DISP display module
  • the information displayed can be for example a list of contacts, images, or graphic elements with which are associated for example telephone numbers, e-mail addresses, pseudonyms or any other data making it possible to establish a communication with for example people (ie terminals), conversational assistants or institutional services.
  • the DISP module also allows the display of the progress bar indicating the time before the establishment of communication.
  • the device for establishing a communication to at least one terminal by analyzing the eye movements of a user comprises a vibrator motor module (VIB) suitable for restoring thanks to vibration information indicating the time before the call is established.
  • VB vibrator motor module
  • the device for establishing a communication to at least one terminal by analyzing the eye movements of a user comprises an audio module (AUD), as per example a loudspeaker, adapted to reproduce by means of sounds the information indicating the duration before the establishment of the communication.
  • AUD audio module
  • modules described above can be distributed over one or more computer machines such as computers, terminals or servers.
  • FIG. 4 illustrates the main steps of the method of establishing a communication intended for at least one terminal by analyzing the eye movements of a user according to a particular embodiment of the invention.
  • the method being executed simultaneously on two devices DI and D2 of establishment a communication to at least one terminal by analyzing the eye movements of a user.
  • Each device is included in a terminal as described in support of FIGS. 1 and 2.
  • This embodiment of the invention makes it possible to trigger an informal communication remotely and spontaneously.
  • a negotiation is established between the two devices thanks to the messages exchanged and communication can be established.
  • the PI process executed on the DI device will capture, thanks to the camera of the DI device, the eye movements of a D1U user located in his capture field.
  • the captured eye movements are then analyzed during the second step D1_ANA.
  • This step makes it possible, for example, to determine whether the user's gaze remains directed to an area of interest located on the DI device.
  • the method P2 executed on the device D2 will carry out the same steps, respectively D2_CAPT and D2_ANA for a second user D2U.
  • the areas of interest of the DI and D2 devices integrated into the smartphones of the D1U and D2U users, are the contact cards of the users of the D2 and DI devices, respectively.
  • the PI process will move on to the next step D1 DECT.
  • This step will make it possible to determine whether the gaze of the user D1U remains directed for a given period of time towards the contact card of the user D2U displayed on the screen of the device DI included in the first terminal.
  • the evaluation of this duration can for example be done by means of a counter or a stopwatch which will be triggered as soon as the user's gaze remains directed towards the contact card of the user D2U.
  • the method can also apply a time delay, for example of a few milliseconds before starting the counter or the stopwatch.
  • step D1 SND When the threshold value is reached, for example 5 seconds for a stopwatch, the method goes to step D1 SND and sends a message to the device D2U indicating that the user D1U through device DI wishes to establish communication with device D2 and its user D2U.
  • step D2 DECT This step will make it possible to determine whether the gaze of the user D2U remains directed for a given period of time to the contact card of G user D1U displayed on the screen of the device D2.
  • the evaluation of this duration can for example be done by means of a counter or a stopwatch which will be triggered as soon as the user's gaze remains directed towards the contact sheet of the user D1U.
  • the method can also apply a time delay, for example of a few milliseconds before starting the counter or the stopwatch.
  • the method goes to step D2 SND and sends a message to the device D1U indicating to it that the user D2U via the device D2 wishes to establish communication with the DI device and its user DI U.
  • step D2 DECT If the message sent by the device DI to the device D2 is received by D2 while the method P2 is in step D2 DECT and the stopwatch or the counter has reached the threshold value, communication is established by the device D2 with the DI device. Communication can also be established as soon as D2 receives the message sent by DI and even before the stopwatch or counter reaches the threshold value.
  • the user 2 can refuse or validate the establishment of the communication at the end of step D2 DECT and before sending a message to the device D1U indicating that the user D2U by the The intermediary of the device D2 wishes to establish communication with the device DI and its user D1U.
  • This validation or cancellation of the establishment of the communication can be done thanks to a particular movement of the eyes, a movement of the head, a voice command, the pressing of a hardware or software button, or any other interaction with the human interface -machine of device D2.
  • a message can be sent by D2 to Dl, in response to the message received by D2 and sent by Dl, indicating to Dl that the method P2 is at step D2 DECT and that Dl has the possibility of 'establish communication.
  • the communication can be established by the device D2 with the device Dl.
  • a message can be sent by D2 to Dl, in response to the message received by D2 and sent by Dl, indicating to Dl that the method P2 is at step D2 SND and that Dl has the possibility of 'establish communication.
  • the user D2U can, once communication has been established with the user D1U, transfer the call by fixing the contact card of a third user.
  • one of the two users can, during a call, set a new contact card in order to start a three or more conference.
  • FIG. 5 illustrates the main steps of the method of establishing a communication intended for at least one terminal by analyzing the eye movements of a user, when the message requesting establishment of a communication M1 sent by the device D1 to device D2 is received by device D2 a few moments before method P2 is triggered.
  • the environment being as described in support of Figures 1, 2 and 4.
  • the message M1 requesting the establishment of a communication sent by the device D1 is received by D2 3 seconds before the method P2 is started on the device D2. That is to say before step D2 CAPT begins.
  • the message has for example a validity period of 10 seconds. This duration can of course be configured, for example according to the services or the user.
  • D2 will then start a stopwatch or a counter making it possible to determine whether the establishment request M1 sent by D1 is still valid.
  • the method P2 validates the DECT step D2 and the message M1 is still valid, that is to say if the stopwatch started when the message M1 is received is less than 10 seconds, the communication C1 is established by the device D2 with device DI.
  • the method P2 can send a request M2 to DI to establish communication.
  • DI establishes the communication Cl ’.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Telephone Function (AREA)
EP20820480.0A 2019-08-09 2020-07-31 Kommunikationsaufbau durch analyse von augenbewegungen Pending EP4010785A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1909125A FR3099837A1 (fr) 2019-08-09 2019-08-09 Etablissement d’une communication par analyse des mouvements oculaires
PCT/FR2020/051420 WO2021028630A1 (fr) 2019-08-09 2020-07-31 Etablissement d'une communication par analyse des mouvements oculaires

Publications (1)

Publication Number Publication Date
EP4010785A1 true EP4010785A1 (de) 2022-06-15

Family

ID=68807072

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20820480.0A Pending EP4010785A1 (de) 2019-08-09 2020-07-31 Kommunikationsaufbau durch analyse von augenbewegungen

Country Status (4)

Country Link
US (1) US11907422B2 (de)
EP (1) EP4010785A1 (de)
FR (1) FR3099837A1 (de)
WO (1) WO2021028630A1 (de)

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5731805A (en) * 1996-06-25 1998-03-24 Sun Microsystems, Inc. Method and apparatus for eyetrack-driven text enlargement
US8593375B2 (en) * 2010-07-23 2013-11-26 Gregory A Maltz Eye gaze user interface and method
TWI470477B (zh) * 2012-08-29 2015-01-21 Utechzone Co Ltd 眼控溝通系統
US9870591B2 (en) * 2013-09-12 2018-01-16 Netspective Communications Llc Distributed electronic document review in a blockchain system and computerized scoring based on textual and visual feedback
KR20150107528A (ko) * 2014-03-14 2015-09-23 삼성전자주식회사 사용자 인터페이스를 제공하는 방법과 전자 장치
US9843713B2 (en) * 2014-04-02 2017-12-12 Nebulys Technologies, Inc. Systems and methods for video communication
US20150346814A1 (en) * 2014-05-30 2015-12-03 Vaibhav Thukral Gaze tracking for one or more users
WO2016112531A1 (en) * 2015-01-16 2016-07-21 Hewlett-Packard Development Company, L.P. User gaze detection
IN2015DE02924A (de) * 2015-09-16 2015-10-23 Hcl Technologies Ltd

Also Published As

Publication number Publication date
FR3099837A1 (fr) 2021-02-12
US11907422B2 (en) 2024-02-20
US20220300074A1 (en) 2022-09-22
WO2021028630A1 (fr) 2021-02-18

Similar Documents

Publication Publication Date Title
EP2586175B1 (de) Verfahren und vorrichtung zur überprüfung der physischen erkennung zwischen einem anrufer und einem angerufenen
EP3087706B1 (de) Verfahren und system zur kommunikation zwischen webbrowsern mit einer einheitlichen kommunikationsumgebung
EP2158762A2 (de) Verfahren und system zur kommunikation zwischen personen in einem telekommunikationssystem
CN112134788B (zh) 事件处理方法、装置、存储介质、移动终端及电脑
FR3063595A1 (fr) Retardement automatique de la lecture d'un message sur un dispositif
EP4010785A1 (de) Kommunikationsaufbau durch analyse von augenbewegungen
EP3104586A1 (de) Verfahren zur aufteilung eines digitalen inhalts im laufe einer kommunikation
KR102051828B1 (ko) 영상 통화 방법 및 영상 통화 중개 장치
FR2910764A1 (fr) Procede de transmission d'accuse reception d'un message destine a plusieurs appareils, appareil et serveur mettant en oeuvre le procede
EP2950512B1 (de) Verfahren und vorrichtung zur anzeigekontrolle einer gruppe von kontakten
EP4250718A1 (de) Verfahren und vorrichtung zur modifizierung von multimedia-inhalten auf der basis von benutzeraufmerksamkeit
EP4287052A1 (de) Verfahren und vorrichtung zur alarmerzeugung
EP2274882B1 (de) Verfahren zum senden einer nachricht und entsprechende einrichtung und computerprogrammprodukt
FR3033222A1 (fr) Procede de partage d'au moins un flux audio et/ou video lors d'un appel telephonique, terminal, procede de traitement, equipement, produits programme d'ordinateur et supports de stockage correspondants
FR2961991A1 (fr) Procede et dispositif de communication entre systemes de communication
WO2023275475A1 (fr) Procede de gestion d'une passerelle d'acces a un reseau sur un terminal mobile
EP2071782B1 (de) Vorrichtung und Verfahren zum Einsatz eines einheitlichen Nachrichtenübermittlungssystems
FR3032079A1 (fr) Procede de communication de messages permettant le traitement d’information et d’optimiser la bande passante, dispositif de generation et programme d’ordinateur correspondant.
FR2868568A1 (fr) Dispostif d'assistance numerique personnelle interagissant avec une pluralite d'applications logicielles
FR3089083A1 (fr) Procédé et dispositif d’affichage de données de communication
FR2946452A1 (fr) Procede pour le controle de l'attention d'un utilisateur regardant un ecran d'un appareil multimedia connecte a un reseau et systemes le mettant en oeuvre
FR2919142A1 (fr) Procede de controle d'un fournisseur de services a partir d'un terminal mobile
FR2882875A1 (fr) Procede et dispositif de mise en relation automatique de terminaux proches
WO2006092505A1 (fr) Procede et dispositif de mise en relation automatique de terminaux proches
FR3044193A1 (fr) Procede et dispositif de gestion d'une communication

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220228

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20231018