EP3853692A1 - Procédé de commande d'un système embarqué - Google Patents
Procédé de commande d'un système embarquéInfo
- Publication number
- EP3853692A1 EP3853692A1 EP19787331.8A EP19787331A EP3853692A1 EP 3853692 A1 EP3853692 A1 EP 3853692A1 EP 19787331 A EP19787331 A EP 19787331A EP 3853692 A1 EP3853692 A1 EP 3853692A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- virtual object
- hand
- control method
- movement
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/146—Instrument input by gesture
- B60K2360/1464—3D-gesture
Definitions
- the present invention relates generally to a control method for an on-board system on a motor vehicle.
- Modern vehicles in particular private vehicles, include one or more sophisticated on-board systems, for example in charge of information tasks such as location, infotraffic or vehicle condition, entertainment tasks, in particular play music or make phone calls, or comfort tasks like adjusting the vehicle's air conditioning system.
- information tasks such as location, infotraffic or vehicle condition
- entertainment tasks in particular play music or make phone calls
- comfort tasks like adjusting the vehicle's air conditioning system.
- gesture recognition devices for recognizing the position and movements of a user's hand.
- the document WO2015176707 thus describes an input device for a control installation comprising a gesture recognition device and a display device providing a virtual environment to a user, in which the user can virtually manipulate a virtual wheel or joystick.
- this system has the particular disadvantage of having a limited number of interactions with the virtual joystick or wheel.
- this input device according to the prior art requires the display of a virtual environment visible to the user, and it is therefore not compatible with driving a vehicle, in particular a motor vehicle.
- An object of the present invention is to respond to the drawbacks of the document of the prior art mentioned above and in particular, to provide a method for controlling an intuitive on-board system for the user and not constituting a distraction while driving the vehicle.
- a first aspect of the invention relates to a method for controlling an on-board vehicle system, the control method comprising the steps of:
- Such a method makes it possible to control an on-board system intuitively by mimicking movements with the virtual object such as a projection, a push or a grip.
- the virtual object such as a projection, a push or a grip.
- such an ordering process does not require feedback in visual form likely to distract a vehicle driver.
- the virtual object is a deformable virtual object, which makes it possible to add a degree of interaction with the virtual object and therefore with the on-board system.
- a plurality of different commands are interpreted from a plurality of different movements of the virtual object.
- a virtual object according to the present invention allows a large number of interactions and therefore a greater number of commands than with a joystick, a scroll wheel or a virtual switch. For example, it can be projected virtually in at least six directions, resulting in at least six different commands.
- no image of the virtual object or of the digitized hand is displayed to the user, that is to say that the present method excludes displaying the virtual scene or an element of the virtual scene, this in order to avoid any distraction of the driver of the vehicle. For example, no visual feedback is made by this ordering process.
- the present control method provides for a step of generating non-visual feedback, for example tactile, vibratory, sound or olfactory.
- it includes a step of generating a specific sound linked to the movement of the virtual object, which makes it possible to inform the user that the gesture he has mimed in connection with the virtual object has well understood.
- the present control method comprises a step of generating a specific sound linked to the interpreted command.
- a second aspect of the invention is a device for controlling a system embedded in a vehicle, comprising:
- a last aspect of the invention relates to a motor vehicle comprising at least one device according to the second aspect of the invention or else implementing the control method according to the first aspect of the invention.
- FIG. 1 represents a virtual scene according to the present control method
- FIG. 2 represents another virtual scene according to the present control method.
- the control method according to the present invention is implemented by an on-board system in a vehicle, for example a private, utility or commercial vehicle with three or four wheels, the on-board system comprising means for real-time capture d 'a hand of a user.
- the on-board system comprises calculation means comprising one or more calculation and memory units making it possible to model the captured hand as well as generate a virtual object close to this digitized hand and interactions between the digitized hand and the virtual object.
- FIG. 1 thus represents the hand 10 of a user or of a driver, digitized in real time, that is to say that each movement or movement of the hand is acquired and modeled without delay.
- the user's hand is digitized only when it is in a determined position, for example raised or facing a specific area of the dashboard which may contain the capture means, which makes it possible to limit the stresses on the means calculations.
- a virtual object 20 in the form of a ball is generated by the calculation means near the digitized hand 10.
- This virtual object 20 constitutes a means of interaction with the digitized hand 10 and therefore the user's hand, as explained below.
- this virtual object 20 can be generated only when the user's hand is in a determined position or else following a specific gesture by the user's hand, making it possible to trigger the present control method.
- return means 30 for example in the form of an elastic cord or a spring are generated so as to recall the virtual object 20 near the digitized hand 10 of the user.
- a virtual interaction between the virtual object 20 and a movement of the user's hand, captured and transcribed by the digitized hand 10, generates a movement or a displacement of the virtual object 20 in the generated virtual space by the means of calculation.
- the user can make a gesture mimicking the fact of projecting or sweeping the virtual object 20 towards one side of the passenger compartment of the vehicle, for example towards the right according to the arrows of FIG. 1 and the calculation means generate then a movement of the virtual object 20 in this direction.
- the calculation means thus calculate on the basis of this interaction a rapid movement to the right of the virtual object 20 in the virtual space and this movement can be interpreted as a specific command by the calculation means.
- this command can consist of a change in a musical track, or a change in the level of ventilation or temperature of the passenger compartment of the vehicle.
- the recall means 30 will recall the virtual object 20 near the digitized hand 10 of the user as shown in Figure 2, so that it it can be used virtually again, that is to say mimicking a new gesture to enter a new command to the vehicle's on-board system.
- a virtual object 20 according to the present invention can be easily moved or projected virtually by a user, which makes interaction with the embedded system intuitive for a user and prevents any distraction from a driving operation, thereby increasing the safety level of a vehicle carrying such a virtual on-board system.
- the virtual object 20 can be deformable and / or elastic.
- a user can also grasp the virtual object 20 in order to press or overwrite it, which enriches the number of possible interactions with the virtual object 20 and therefore the number of different commands that can be interpreted.
- the recall means allow the virtual object to return to its shape after the command has been interpreted or performed.
- the virtual object 20 can also be projected virtually to specific areas of the vehicle interior, each corresponding to a specific command.
- the user can mimic the projection of the virtual object towards the cabin air vents in order to adjust a level of ventilation of the vehicle.
- the digitized hand 10 or the virtual object 20 are not represented or displayed in the driver's view, this in order to prevent any distraction during a driving operation of the vehicle.
- the driver or user therefore has no visual means of knowing that the desired command has been interpreted correctly by the calculation means.
- a specific sound can be generated in order to constitute feedback in the passenger compartment of the vehicle.
- this sound can be linked to a movement of the virtual object 20, for example a rolling or bouncing sound.
- the sound generated can be linked to the interpreted command, for example a breath sound in the case of ventilation or a selection or bell sound, depending on the command carried out.
- a change of musical track or a modification of the volume level can also inform the user that the command has been interpreted correctly from the movement of his hand via the movement of the virtual object.
- a vehicle interior screen can represent only the result of the command, such as a sound volume scale, a ventilation level scale or a change of musical track or radio, without displaying the virtual scene. including the digitized hand 10 or the virtual object 20.
- the return means 30 which can be implemented in different forms, in addition to the elastic cord or the spring already mentioned.
- the digitized hand 10 can attract the virtual object 20 on the model of a gravitational force.
- the virtual object projected beyond a certain limit for example beyond the virtual space generated by the computing means, can be deleted and regenerated near the digitized hand 20.
- the virtual object 20 is not limited to a ball as shown in Figures 1 and 2, but includes any type of appropriate virtual object, for example an oval ball, a block, a cube or whatever.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR1858582A FR3086420B1 (fr) | 2018-09-21 | 2018-09-21 | Procede de commande d’un systeme embarque |
| PCT/FR2019/052056 WO2020058598A1 (fr) | 2018-09-21 | 2019-09-06 | Procédé de commande d'un système embarqué |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP3853692A1 true EP3853692A1 (fr) | 2021-07-28 |
Family
ID=65243753
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP19787331.8A Withdrawn EP3853692A1 (fr) | 2018-09-21 | 2019-09-06 | Procédé de commande d'un système embarqué |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP3853692A1 (fr) |
| FR (1) | FR3086420B1 (fr) |
| WO (1) | WO2020058598A1 (fr) |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130204457A1 (en) * | 2012-02-06 | 2013-08-08 | Ford Global Technologies, Llc | Interacting with vehicle controls through gesture recognition |
| DE102012216193B4 (de) * | 2012-09-12 | 2020-07-30 | Continental Automotive Gmbh | Verfahren und Vorrichtung zur Bedienung einer Kraftfahrzeugkomponente mittels Gesten |
| EP3018568A4 (fr) * | 2013-07-05 | 2017-04-19 | Clarion Co., Ltd. | Dispositif de traitement d'information |
| DE102014107220A1 (de) | 2014-05-22 | 2015-11-26 | Atlas Elektronik Gmbh | Eingabevorrichtung, Rechner oder Bedienanlage sowie Fahrzeug |
-
2018
- 2018-09-21 FR FR1858582A patent/FR3086420B1/fr active Active
-
2019
- 2019-09-06 EP EP19787331.8A patent/EP3853692A1/fr not_active Withdrawn
- 2019-09-06 WO PCT/FR2019/052056 patent/WO2020058598A1/fr not_active Ceased
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020058598A1 (fr) | 2020-03-26 |
| FR3086420A1 (fr) | 2020-03-27 |
| FR3086420B1 (fr) | 2020-12-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108475120B (zh) | 用混合现实系统的远程设备进行对象运动跟踪的方法及混合现实系统 | |
| EP2478513B1 (fr) | Procédé de simulation de mouvements propres par retour haptique et dispositif mettant en oeuvre le procédé | |
| FR3052889B1 (fr) | Correction d'erreur induite par des vibrations pour affichage a ecran tactile dans un aeronef | |
| US20110310001A1 (en) | Display reconfiguration based on face/eye tracking | |
| KR102708300B1 (ko) | 차량 및 차량의 제어방법 | |
| WO2014106594A1 (fr) | Element mobile de commande prehensible simulant un joystick ou manette de jeu equivalente a au moins un element de commande a butee physique, et procede de simulation associe | |
| CN117115399A (zh) | 用于与所识别的对象相关联地呈现合成现实内容的方法和设备 | |
| FR3005173A1 (fr) | Procede d'interaction dans un cockpit d'aeronef entre un pilote et son environnement | |
| WO2015104482A1 (fr) | Interface homme machine pour véhicule automobile | |
| EP3853692A1 (fr) | Procédé de commande d'un système embarqué | |
| FR3092415A1 (fr) | Procédé de génération d’un retour sensitif pour une interface et interface associée | |
| WO2010037795A1 (fr) | Procédé de commande et système d'aide à la conduite associé | |
| US20230049900A1 (en) | Displaced haptic feedback | |
| EP1807752B1 (fr) | Dispositif autonome, systeme et procede de navigation dans un espace a au moins trois dimensions | |
| FR3069936B1 (fr) | Interaction tactile avec des ihm dans un environnement immersif | |
| EP3218219B1 (fr) | Interface homme/machine et procédé de contrôle de fonctions d'un véhicule par détection de mouvement et/ou d'expression du conducteur | |
| FR3086625A1 (fr) | Dispositif d’affichage a ecran tactile affichant dans des zones independantes des pages d’imagettes associees a des fonctionnalites d’un vehicule | |
| JP7805522B2 (ja) | 移動体遠隔操縦システム、移動体遠隔操縦装置、および移動体制御装置 | |
| EP2054906B1 (fr) | Dispositif de commande d'organes electriques ou electroniques | |
| CN107608501B (zh) | 用户接口设备及包括其的车辆以及控制车辆的方法 | |
| FR3080928A1 (fr) | Dispositif de detection de gestuelles de doigt(s) et de main d’un conducteur de vehicule pour controler des fonctions | |
| FR3020153A1 (fr) | Rotation egocentrique naturelle en environnement virtuel | |
| FR3107478A1 (fr) | Console centrale de véhicule comportant un dispositif de commande avec rétroaction haptique | |
| FR3140459A1 (fr) | Gestion de la fourniture d’une interface graphique sur un écran sphérique d’une interface homme-machine d’un véhicule automobile | |
| FR2989486A1 (fr) | Systeme pour designer et activer une cible dans une scene de l'environnement visuel d'un operateur |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20210303 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| RAP3 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE Owner name: STELLANTIS AUTO SAS |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
| 18D | Application deemed to be withdrawn |
Effective date: 20240403 |