FR3023513A1 - INTERACTION METHOD FOR DRIVING A COMBINED INSTRUMENT OF A MOTOR VEHICLE - Google Patents

Abstract

Interaction method for a motor vehicle, the vehicle comprising an instrument cluster (1) with a digital display zone, a steering wheel (2) with a main recess through which the driver has a vision of the instrument cluster from a reference point of view, a pick-up device (3, 3 ') for picking up positions and / or movements on a pickup zone (30, 30'), the method comprising the following steps: a) identifying a pickup object interest in the capture area, for example a finger defining a first position (P1), b) determining a graphic entity of the digital display area, the graphic entity being located in the extension of a straight line that passes by the reference point of view and the first position, c) detecting a movement of the object of interest, d) modifying the graphic entity according to the motion detected

Description

The present invention relates to methods and systems allowing a driver to interact with the instrument cluster of a motor vehicle, especially in a driving situation, particularly when the vehicle is traveling. More specifically, it is concerned with methods and systems enabling the driver to interact intuitively, safely and easily with the main instrument cluster in front of the driver, the steering wheel of the vehicle being interposed between said instrument cluster and the driver. More particularly, a graphical interface is preferred, that is to say the possibility of "pointing" remotely on a graphic object of the instrument cluster and to initiate an action relative to this graphic object by means of a gesture, without touching the surface of the instrument cluster. It is known from document GB 2 423 808 to arrange a tactile tactile surface ("tactile carpet"), for example on the central console, which makes it possible to move a pointer on the instrument cluster. However, this solution implies that the driver mobilizes one of his hands on the touch mat that is at a distance from the steering wheel, which is not optimal in terms of driving safety. It has therefore appeared a need to provide an improved solution for enabling remote interactions of the driver with the instrument cluster. According to the invention, there is provided an interaction method for a motor vehicle driven by a driver, the vehicle comprising: - an instrument cluster forming a display device with at least one digital display area, - a steering wheel with a main recess through which the driver has a vision of the instrument cluster from a reference point of view, 25 - a capture device for capturing positions and / or movements on a capture area substantially coinciding with at least part of the main recess of the steering wheel. The method is remarkable in that it comprises the following steps: a) identifying an object of interest in the catchment area, the object of interest being formed by a hand portion of the driver (or finger (s) end (s) of finger), the position of the object of interest defining a first position, b) determining a graphic entity of the digital display area on the instrument cluster, said graphic entity being located in the extending a straight line which passes through the reference point of view and the first position defined by the object of interest, c) detecting a movement of the object of interest formed by the hand portion of the driver, d. ) change the graphic entity according to the motion detected. Thanks to such a method, we obtain an interaction by a simple and intuitive gesture with the digital handset, generally analogous to gestures commonly used in graphic interfaces. In addition, advantageously, the driver keeps hands in the immediate vicinity of the steering wheel in driving situation (while driving), without touching the handset, and without passing the hand through the steering wheel to touch a potential touch sensitive surface of the handset. instruments. In various embodiments of the method according to the invention, it is possible to make use of one and / or the other of the following provisions: The object of interest formed by the hand portion is preferably constituted by a finger of the hand; This provides a simple and intuitive graphical interaction with the digital handset, analogous to a tactile touch-screen interface, digital tablet or mobile phone ("smartphone"), but remotely. The first position is advantageously defined by the end of the finger. By means of which one can obtain a good precision and designate precisely a graphic object (or a graphical entity) even small (e). The main recess is arranged above the steering axis when the steering wheel is substantially driving position in a straight line. In fact, the driver has a good and wide vision of the handset, which provides an extended area for multiple graphic entities in the digital display area. The position and motion capture device may be arranged in the steering wheel on the lower edge of the main recess. Thus the driver does not need to pass the hand even partially through the steering wheel, it is sufficient that the tip of his finger is positioned in the capture area. The position and motion capture device may be arranged on a fixed part of the steering column behind the steering wheel, so that there is no need to transmit the information from a rotating part. In addition, it works identically even for non-zero flying angles. The position and motion capture device is formed by a series of optical sensors of the infrared diode type. This is a simple solution with mastered technology, and more insensitive to electromagnetic disturbances. The catchment area may be delimited by the lower edge of the main recess and has a height of the order of 15 cm, to a depth of at least 5 cm along an axis X (volume case vs. single barrier case). rear of the median plane of the rim, or on both sides of the median plane; so that the catchment area is relatively well circumscribed, centered on the main recess. This avoids inadvertently taking into account gestures other than those voluntarily made within the catchment area. The X axis is perpendicular to the plane containing the rim of the steering wheel and is coincident with the axis of rotation of said flywheel. The reference point of view is defined by the mid-point of the eyes of the head of a median conductor in the reference position, namely in the center of a position probability ellipse of the middle of the driver's eyes. Thus, a reference position of the user's vision is chosen which turns out to be statistically the most probable. In particular, the detection of movements in the left-right and up-down directions is treated, in particular with: a movement towards the right leading to the passage to a previous item on the graphic entity, a movement to the left causing the move to a next item, - an upward movement leading to open and / or enlarge the display - a downward movement leading to close and / or shrink the display and / or validate. With this, intuitive movements analogous to gestures commonly used with a mobile phone ("smartphone") are used to interact with the digital display of the instrument cluster. In step a), preferably, it is verified that the object of interest remains substantially immobile for a predetermined time, between 150 ms and 500 ms; this makes it possible to identify a stopping point ("point of attachment") forming the beginning of a voluntary movement made by the driver; Furthermore, the invention also provides a driver-driven system for a motor vehicle comprising: - an instrument cluster forming a display device with at least one digital display area, - a steering wheel with a main recess through which the driver has a view of the instrument cluster from a reference point of view; - a position and motion pick-up device with a pickup zone substantially coinciding with at least a portion of the recess; main steering wheel, the system being configured to implement the method defined above. Other aspects, objects and advantages of the invention will appear on reading the following description of one of its embodiments, given by way of non-limiting example. The invention will also be better understood with reference to the accompanying drawings, in which: FIG. 1 represents a general diagram of a system in which the method according to the invention can be implemented, seen from the point of view of the driver, FIG. 2 shows a side view of the system shown in FIG. 1; FIG. 3 represents a broader side view of the system shown in FIG. 1, with geometric construction; FIG. 4 is similar to FIG. FIG. 5 shows a detail view of an example of the capture zone and the associated sensors, FIG. 6 represents a use situation according to the method presented, FIG. 7 shows a functional diagram. of the capture device including in particular the sensors. FIG. 1 shows the central zone of the driving position from the point of view of the driver U. In the driver's station, in front of the driver U, there is an instrument cluster 1 which, in this case, has a zone d digital display 11 (LCD or pixelated), a steering wheel 2 for steering the vehicle, the steering wheel 2 being rotatably mounted about the X axis and comprising a rim 25. The instrument cluster 1 forms a device display which may further include various witnesses, lights, dials, known per se. As illustrated in FIGS. 1 to 4, the illustrated steering wheel 2 comprises three branches, which together with the rim 25 define two lower recesses 21A, 21B and an upper recess 20 through which the driver U has a partial or almost total vision of the combined Moreover, the steering wheel 2 comprises a central hub 61 in which is usually housed an airbag type air bag. Of course, the invention can be applied to a current steering wheel configuration with four branches, without excluding the case of a steering wheel 2 with two branches or mono-branch. For the purposes of the present invention, the upper recess 20 of the wheel 2 will also be called "main recess". As illustrated in particular in FIGS. 3 and 4, a reference point PO is defined, from which the driver U sees the instrument cluster 1 and in particular the digital display zone 11. Advantageously, the point of view of FIG. PO reference is defined by the midpoint of the eyes of the head of an average conductor U in reference position defined by a "probability ellipse". As illustrated, the so-called E95 probability ellipse encompasses the viewpoint positions of 95 (3/0 of users, whose PO position is the center, and the so-called "99 (3/0)" probability ellipse. which includes the viewpoint positions of 99% (3/0 of the users) Note that the major axis of this ellipse E95 is almost aligned with the line D1 (or even the set of possible lines D1). embodiment, there is arranged, in the steering wheel 2 and under the border 21 which delimits from below the main recess 20, a capture device 3 for capturing positions and / or movements of the hands 4 of the driver U as will be seen in FIG. detail below.

More particularly, a capture zone 30 is defined in which the capture device 3 will be able to detect fixed or moving objects; this capture zone 30 substantially coincides with at least a portion of the main recess 20 of the flywheel 2. More particularly, this capture zone 30 includes the central portion of the space defined by the main recess between the rim 25 and the hub 61; it is preferably delimited downwards by the edge 21 of the main recess 20, its height U (see Figure 5) along the axis W may be close to 15 cm; its depth M along the axis X can be close to 5 cm, and its position relative to the median plane of the rim 25 of the wheel 2 can be centered or adjusted so that it does not exceed the plane K of the surface of the rim 25 of the flywheel 2 on the driver's side U (reference 30, FIG. 2). In the illustrated example, there is a series of sensors 27, preferably one after the other, generally along the direction V, along the upper edge of the hub 61, ie along the lower edge 21 of the main recess 20.

The sensors 27 of the capture device 3 may be capacitive, ultrasonic, optical or other, provided that they allow detection over a detection distance of at least a few centimeters, preferably about ten centimeters. According to the present invention, at least one finger 5 of a hand 4 of the conductor U, preferably in particular the end 50 of a finger 5, is detected by means of the capture device 3. The end 50 of the finger 5 thus detected makes it possible to define a first position Pi, which makes it possible to construct a straight line D1 which passes through this first position P1 and by the reference position PO. This line D1 intersects the display surface of the instrument cluster 1 instead of the point referenced P2. This point P2 makes it possible to determine a graphic entity 10 of the digital display area on the instrument cluster 1, the graphic entity 10 being on the point P2 or being the one closest to the point P2; this graphic entity 10 may be a pictogram or a display element on which the driver U may want to interact, for example to select a function, another display mode, indicate a desire for change or action to be undertaken . In other words, the graphic entity of interest 10 is situated in the extension of the geometrically constructed straight line D1 which passes through the reference point PO and the first position P1 defined by the end 50 of the finger 5. of the conductor U, that is to say, the graphical entity of interest 10 is seen by the conductor U at the end 50 of its finger 5. It is then clear that the dimensions of the capture zone 30 are defined so that the set of straight lines that pass through the point PO and the points of the capture zone 30 make it possible to define a set of points P2 projected on the instrument cluster 1 which covers the whole area The illustrated example shows generally rectangular shapes, but other shapes are not excluded. It is important to note that, in place of a finger 5 of the hand 4, 15 according to the method presented, it is possible to use more generally a hand portion 4, for example it could be several fingers together, closed fist, etc. this is the reason why we speak of an "object of interest" formed by at least a portion of the hand 4 of the driver U. Note that if the driver U is gloved it can be the tip of a finger glove that forms the object of interest. The object of interest could even be an object held in the hand 4 of the driver U (cigarette, telephone, other). However, it will be understood that the most typical case will be the use of the conductor index U. FIG. 5 illustrates optical type sensors 27, more particularly infrared diodes, arranged one after the other. . Preferably, a resistor diode Tx (27T) and a receive diode Rx (27R) are alternated (see FIG. 7). The analysis of the signals received by a reception diode 27R is made on the one hand under natural lighting (in the absence of control of the emission diodes 27T) and on the other hand under artificial lighting, that is to say say while the 27T transmit diodes are emitting. It can be provided a method of "polling", that is to say rapid recurrent sweeping of all the diodes one after the other. The luminous intensity received by each receiving diode 27R, with and / or without active infrared illumination, is measured periodically by sampling to deduce the presence of a finger 5 in the action radius 27A of each diode, as well as the distance of the finger 5 relative to the lower edge 21 of the main recess. The method according to the invention can then be formulated by a succession of steps, as follows: a) identify an object of interest (hand portion 4, finger (s) 5, finger end (s) 50) in the capture area 30, b) determine the graphic entity 10 of interest in the digital display area 11 on the instrument cluster 1, determined by the construction of the straight line D1 (PO - P1 - P2) at point P2, c) detecting a movement of the object of interest (hand portion 4, finger (s) 5, finger end (s) 50), d) modifying graphic entity 10 according to motion detected. Examples will be given in the following. As illustrated by means of FIG. 6, the capture device 3 operates in step c) a detection of movements of the object of interest, among which it will try to recognize simple movements such as displacement. to the left, move to the right, move up, move down. Advantageously according to the invention, provision can be made for the pickup device to start by detecting an "attachment point" which corresponds to a substantially immobile position of the object of interest for a predetermined time, between 150 ms and 500 ms. , which makes it possible to identify the beginning of a voluntary movement made by the conductor U. In other words, according to this optional feature, the position P1 is kept fixed for a predetermined short time. This forms a "score" which can be accompanied by a graphical enhancement of the graphical entity selected in the digital display 11 of the instrument cluster 1. This enhancement can be done by a magnification of the pictogram, a shadow effect, color change, etc. Among the privileged movements, it is expected that a movement towards the right D causes the passage to a previous item on the graphical entity 11; similarly it is expected that a leftward movement G will lead to a next item, as shown in Fig. 6 the conductor U slides its finger from the point P1 to the point P1 '. In the same spirit, as a non-limiting example, an upward movement H may preferentially lead to opening and / or enlarging the display of the selected graphic entity 11, a downward movement B may lead to closing and / or 30 shrink the display of the selected graphical entity 11. As illustrated in FIG. 7, the capture device 3 comprises, in addition to the sensors 27, 271, 27R already mentioned, a local electronic processing unit 6 in the steering wheel 2, a functional management unit 8 which receives the position information. 6, and which sends commands to the instrument cluster 1. When the link between the processing unit 6 and the functional management unit 8 is wired, it goes through a rotary switch 66.

Optionally, it may be provided that the transmission of information from the steering wheel 2 to a non-rotating element is made by infrared, using infrared transmitters 271 present for the detection; in which case we avoid going through a rotary switch.

The geometric construction corresponding to the straight line D1 is calculated by the management unit 8 which also takes into account a possible angle of the flywheel 2 nonzero with respect to the straight line (correction "TETA Volant" 69); indeed, when the capturing device 3 is embedded in the steering wheel 2, it detects the relative positions of the finger (s) relative to the steering wheel 2 and not in absolute terms.

To illustrate functionally by an example, the driver U can use the presented method to select music pieces from a list displayed in the instrument cluster 1. Pictograms representing song authors, music tracks, musical styles, albums, can be presented as graphic entity (s) 10 in the digital display zone 11. The driver U can point with the tip of his finger 5 the various pictograms, select / open items with a sliding movement up, scroll items with left or right movements, deselect / close items with a downward sliding motion. Thus, the driver U keeps the hand mobilized to do so in the immediate vicinity of the rim 25 of the steering wheel 2, or even in contact with the latter, keeping the eye directed straight ahead. It will therefore be understood that the proposed interaction is particularly advantageous from the point of view of driving safety, since the interaction presented can be used while the vehicle is running under the control of the driver U.

Similarly, the driver U can set, for a speed control system with distance control, the type of distance control setpoint vis-à-vis the preceding vehicle among a plurality of possibilities (very close, close, average , distant). After that, the control system only adjusts the effective tracking distance in accordance with the speed and external parameters (rain, wiper activated, etc.). The driver U can adjust other driving parameters in real time while driving. Alternatively, according to a second embodiment, the capture device 3 'can be implanted behind the steering wheel 2 in a fixed, non-rotating part of the steering column. In this case, the capture zone 3 'will be a little behind the flywheel 2 with respect to the conductor U (reference 30', FIG. 2), but it will thus be avoided to pass through a rotary switch to supply the pick-up device 30 '. or even retrieve the information it generates. According to a third embodiment (not shown in the figures), instead of using a series of sensors 27 having a relatively limited detection distance, one or two cameras and an image processing method could equally well be used. to detect objects in the target capture area 30. Another example of use of the present invention is to navigate in a map application such as GoogleMaps® or Mappy®. We can manipulate the cards as we do on a mobile phone ("smartphone"), but at a distance. In addition, for this purpose, it can be provided that the capture device 3 can capture two distinct objects in the capture area and their relative displacement. For example, the two distinct objects may be two fingers 5 of a hand 4 of the driver U; this makes it possible to propose the magnification / shrinkage function, with two fingertips 5, by moving them apart or bringing them together, as is now well known on the graphical interfaces of digital devices with a touch screen.

Claims (11)

REVENDICATIONS1. Interaction method for a motor vehicle driven by a conductor (U), the vehicle comprising: - an instrument cluster (1) forming a display device with at least one digital display area (11), - a steering wheel (2) with a main recess (20) through which the conductor (U) has a view of the instrument cluster (1) from a reference point of view (PO), - a capturing device (3, 3 ' ) for sensing positions and / or movements on a pickup zone (30, 30 ') substantially coinciding with at least a portion of the main recess (20) of the flywheel (2), the method comprising the steps of: a) identifying at least one object of interest in the capture zone (30, 30 '), the object of interest being formed by a hand portion (4) of the conductor (U), the position of the object of interest defining a first position (P1), b) determining a graphic entity (10) of the digital display area on the handset of inst ruments (1), said graphic entity (10) being located in the extension of a straight line (D1) which passes through the reference point of view (P0) and the first position (P1) of the hand portion (4). ) of the conductor (U), c) detecting a movement of the object of interest formed by the hand portion (4) of the conductor (U), d) modifying the graphic entity (10) according to the detected motion. 2. Method according to claim 1, wherein the object of interest formed by the hand portion (4) is constituted by a finger (5) of the hand (4). 3. The method of claim 2, wherein the first position (P1) is defined by the end (50) of the finger (5). 4. Method according to any one of claims 1 to 3, wherein the device for capturing (3) position and movement is arranged in the steering wheel (2) on the lower edge (21) of the main recess (20). ). 5. Method according to any one of claims 1 to 3, wherein the capture device (3 ') position and movement is arranged on a fixed portion of the steering column, behind the steering wheel (2). 6. Method according to any one of claims 1 to 5, wherein the capture device (3, 3 ') position and movement is formed by a series of optical sensors (27) of the infrared diode type. 7. Method according to any one of claims 1 to 6, wherein the capture zone (30, 30 ') is delimited by the lower edge (21) of the main recess (20) and has a height of the order of 10 to 15 cm, to a depth of at least 5 cm along an axis (X) perpendicular to the plane containing the rim (25) of the wheel (2) and passing through the center of rotation of said wheel (2). The method according to any one of claims 1 to 7, wherein the reference point of view (P0) is defined by the midpoint of the eyes of the driver's head (U) in the reference position, namely in the center an ellipse (E95) of position probability of the middle of the driver's eyes (U). 9. Process according to any one of claims 1 to 8, in which the detection of movements in the left-right and up-down directions is particularly treated, in particular with: a movement towards the right (D) causing the switching to a previous item on the graphic entity (10), - a leftward movement (G) leading to the next item, - an upward movement (H) leading to opening and / or enlarging the display A downward movement (B) leading to closing and / or shrinking the display and / or validating. The method according to any one of claims 1 to 8, wherein in step a), it is verified that the object of interest remains substantially immobile for a predetermined time, between 200 ms and 500 ms, which identifies the beginning of a voluntary movement made by the driver (U); 11. Interaction system for a motor vehicle driven by a conductor (U) comprising: - an instrument cluster (1) forming a display device with at least one digital display area (11), 30 - a steering wheel (2) with a main recess (20) through which the conductor (U) has a view of the instrument cluster (1) from a reference point of view (PO), - a position capturing device (3) and movements with a pickup zone (30) substantially coinciding with at least a portion of the main recess (20) of the flywheel (2), the system being configured to carry out the method according to one of the preceding claims.