WO2018206450A1

WO2018206450A1 - System for triggering a user specific function of a motor vehicle and a method therefor and an automobile comprising such system

Info

Publication number: WO2018206450A1
Application number: PCT/EP2018/061569
Authority: WO
Inventors: Biyun ZHOU
Original assignee: Bayerische Motoren Werke Aktiengesellschaft
Priority date: 2017-05-12
Filing date: 2018-05-04
Publication date: 2018-11-15
Also published as: CN108874116B; CN108874116A

Abstract

The invention concerns a system (1) for triggering a user (2) specific function of a motor vehicle (7), comprising: an access control unit (5) connected to a camera (4) which is arranged at a door (14) of the motor vehicle (7) to recognize a hand (3) of a user (2) next to the motor vehicle (7), wherein the access control unit (7) is arranged to receive a set of data (5a) representing the hand (3) of the user (2) and the data from the camera (4) and to compare the set of data (5a) with a predefined reference (5b) and, in case the set of data (5a) matches with the predefined reference (5b), to send a control signal to an electronic control unit (6) of the motor vehicle (7), wherein the camera (4) and the electronic control unit (6) are arranged at at least one passenger door (14a, 14c, 14d).

Description

System for Triggering a User Specific Function of a Motor Vehicle and a Method Therefor and an Automobile

Comprising Such System

Description

The present invention refers to a system for triggering a user specific function of a motor vehicle and a method therefor and an automobile comprising such system.

On demand mobility (ODM), including car sharing and ride sharing, is of growing interest, especially in big cities. In car sharing, users are registered in a pool of a car sharing provider and the users are able to book and drive the car of said provider. In ride sharing, the user is the passenger in the car and can be chauffeured from A to B, wherein the user is registered in a pool of a ride sharing provider. Several persons, depending on the capacity of the car, can use the ride sharing service at the same time. Normally, both services, car sharing and ride sharing, are booked over the smart phone. However, if the smart phone gets stolen, lost, the battery is empty or the user forgets a user specific PIN, the car of the car sharing service can neither be entered nor started. DE 10 2014 01 1 806 A1 suggests a solution by providing a car opening and starting mechanism, wherein the hand vein pattern of a user at the driver side is scanned by an infrared camera at the driver door which connected to a control unit which sends an unlock signal to an unlock unit at the driver door if the hand vein pattern matches with a predefined valid hand vein pattern. However, for ride sharing services different problems occur. Often, the wrong persons are picked up, e.g. in chaotic situations at crowded places like e.g. at public events, at an airport or a train station. Furthermore, the door handles of the car are damaged due to their frequent use. In addition, the driver of the ride sharing service can often not get out of the car in order to open the door for passengers because of the traffic. Besides, users of ride sharing services are often stressed and want convenient settings concerning e.g. audio, air condition, seat position and heating without further effort and manual interaction with the car. Thus, the interaction for the ride sharing user with the car is not convenient.

It is an object underlying the present invention to provide a system and a method for triggering a user specific function in a motor vehicle to enable a more convenient interaction with different functions of a motor vehicle for ride sharing users.

The object is achieved by a system for triggering a user specific function of a motor vehicle of claim 1 . Thus, according to a first aspect of the present invention, a system for triggering a user specific function of a motor vehicle is suggested. The system comprises an access control unit connected to a camera which is arranged at a door of the motor vehicle to recognize a hand of a user next to the motor vehicle. The access control unit is arranged to receive a set of data representing the hand of the user and the data from the camera and to compare the set of data with a predefined reference. In case the set of data matches with the predefined reference, a control signal is sent to an electronic control unit of the motor vehicle. Furthermore, the camera and the electronic control unit are arranged at at least one passenger door.

The inventive system can for example use the car battery or its own battery as a source of energy or any other suitable known technical means. The term "user specific function of a motor vehicle" includes all mechatronic and electronic functions inside and outside a motor vehicle for which any interaction with the passenger is given, especially seat position-specific functions which are arranged by the present invention. Furthermore, the term "motor vehicle" in the present invention comprises all motor vehicles comprising a door into which a passenger can enter. The inventive system for triggering a user specific function of a motor vehicle comprises an access control unit which is a processing and storage unit which is connected to the camera and which is capable of storing at least one predefined reference and which is also capable of receiving and processing a set of data representing the hand of a user. The access control unit can also compare the set of data with the predefined reference. This can be realized by any known technical means. Furthermore, the access control unit is able to send a control signal to the electronic control unit, in case the set of data and the predefined reference match.

The inventive system comprises a camera which can be any camera known in the art which is capable to recognize a hand of a user next to the car. The user is normally the ride sharing user or, in other words, the ride sharing passenger. Also, the camera is arranged at at least one passenger door. The term

"passenger door" relates to all doors of a motor vehicle into which a

passenger/user can enter excluding the driver door. The hand of the user can be the left and/or the right hand and/or the front and/or the back hand. The hand of the user, recognized by the camera, is converted into a set of data representing the hand, wherein said conversion can be realized by any known technical means. The set of data is then received by the access control unit and compared with a predefined reference within the same. In case the predefined reference and the set of data representing the hand of the user match, a control signal is sent to an electronic control unit of the motor vehicle.

The electronic control unit of the inventive system is capable to trigger any electronic and/or mechatronic function of the car relating to the passenger door and its environment (e.g. the periphery of the user seat and the seat itself), i.e. a user specific function, at respective door of the motor vehicle, where the hand of the user has been recognized. The electronic control unit can be realized by any known technical means. Information about the user specific function triggered by the electronic control unit is transferred over the control signal to the electronical control unit. The interaction of the user with the user specific functions of the motor vehicle is therefore touchless and more convenient.

Thus, a system for triggering a user specific function of a motor vehicle which enables a more convenient interaction between the ride sharing user and different functions of the motor vehicle is provided.

The dependent contain advantageous embodiments of the present invention. According to a preferred embodiment of the inventive system, the camera includes an infrared camera, wherein any suitable infrared camera known in the art is possible. Due to the infrared camera, a more precise and a more unique recognition of the user's hand is achieved.

According to another preferred embodiment, the system is arranged to adjust the settings for the seat and a periphery of the seat according to preferred settings of the user, after the control signal is sent. This enables a quick and convenient adjustment to the preferred settings of the user. A data representing said preferred settings can for example be stored in the access control unit as an information in the predefined reference. The access control unit can e.g. receive said data representing said preferred settings over conventional technical means by transmission of the ride sharing provider after said preferred settings have been transmitted from the user to the ride sharing provider or directly from the user.

According to another advantageous embodiment, the passenger door is a co- driver door and/or a second or even third seat row door. The first alternative can be advantageous, if the ride sharing motor vehicle has only two seats or doors. However, this alternative can also be arranged in a motor vehicle with more than two seats, e.g. a limousine, an SUV or a van. The second seat row is the typical position for passengers entering a ride sharing motor vehicle having more than two seats. Those alternatives can also be combined for motor vehicles which especially are used, if many persons have to be transferred, e.g. at rush hour. Thus, a high variability for the type of the motor vehicle used in the ride sharing service is achieved by the inventive system.

According to a further preferred embodiment, the inventive system further comprises a camera, which is connected to the access control unit wherein said camera is arranged at the driver door. Therefore, also the driver of the car can take benefit of the advantages of the user specific settings triggered.

According to another preferred embodiment, the predefined reference comprises information related to a hand vein pattern, a hand geometry or a relation of the finger length of at least two fingers of the hand. As mentioned above, the predefined data including the information are stored in the access control unit. The access control unit can obtain said predefined references by conventional data transfer, e.g. from the ride sharing provider or from the user himself. The data, on which said information are based, can for example be recorded by suitable known scanners or merely by a photo camera.

In a further preferred embodiment of the inventive system, all doors of the motor vehicle comprise the respective camera. Therefore, high comfort requirements are met, for the driver and the passengers.

In another preferred embodiment of the inventive system, the access control unit is capable of saving a plurality of predefined references. Thus, more than one user can trigger his specific functions, when using the ride sharing service which results in a higher flexibility of the user interaction with the user specific functions of the motor vehicle. In a more preferred embodiment, said predefined references are assigned to a distinct seat in the motor vehicle. Hence, e.g. a highly suitable selection of the seat position is possible, e.g. if one user is tall and he wants to sit in the front. In this case, the user can easily book a distinct seat.

According to another preferred embodiment, the electronic control unit is connected to a seat specific control unit which is arranged to adjust a seat specific setting in accordance with the predefined reference. The seat specific setting is a user specific function of the motor vehicle. Its effect in particular is related to this specific seat position rather than other seat positions. The control signal sent to the electronic control unit enables the same to trigger the seat specific control unit. Such, the convenience for the user regarding the interaction with the car is further increased. Thus, the predefined reference can further comprise information about the seat specific setting. Said seat specific settings can be any settings relating to the seat and its periphery. Such seat specific setting can for example be adjusted by values entered by the user via e.g. an online portal of the ride sharing provider. According to a further preferred embodiment, the seat specific setting comprises an adaption of seat position configuration and/or a predetermined setting of the air condition and/or of a heater and/or an audio system setting and/or an entertainment system setting. Thus, an increased convenience for the user is obtained. More preferably, if the user is the driver, a steering wheel position is also adjusted. This also provides a higher convenience for the driver.

In a further preferred embodiment, the predefined references are associated with a plurality of seat specific settings. This means that the electric control unit can trigger the regulation of a plurality of seat specific settings at once, wherein a higher comfort is provided to a user.

In another preferred embodiment, the electronic control unit is arranged to unlock the respective door. The respective door is only unlocked, if the predefined references match with the set of data representing the hand of the user recognized by the camera in the access control unit. This is a benefit in a stressful situation, when the driver cannot open the motor vehicle door (e.g. in case of much traffic) or in order to avoid that the driver picks up the wrong person. Vice versa, it is avoided for the user to enter the wrong motor vehicle. More preferably, the electronic control unit is also arranged to open the respective door. This is advantageous, since the mechanical damage to the door handles is avoided and maintenance costs are saved. Especially, when the control unit is arranged to open the respective door, in a further preferred embodiment, at least the respective door including the respective camera is free of door handles on the outside. Thus, a completely touchless system for triggering a user specific function can be provided.

In another preferred embodiment of the inventive system, the camera is arranged in the door handle on the outside. Therefore, a quick and efficient opening is possible, since the user has not to search for the camera position in the first place.

The present invention further relates to a method of triggering a user specific function of a motor vehicle. A first step includes a touchless detecting of a hand of a user next to the motor vehicle. Therefore, a facile initial interaction is provided. A second step includes receiving a set of data representing the hand of the user. A third step includes comparing the set of data representing the hand of the user with a predefined reference. A fourth step comprises sending the control signal, if the set of data representing the hand of the user and the predefined reference match. A fifth step includes triggering of the user specific function.

Therefore, a method can be provided which enables a facile and more

convenient interaction between the user specific functions of a motor vehicle and a user.

Furthermore, features, explanations, advantageous effects and embodiments of the inventive system also relate to those of the method of the present invention, wherein those features, explanations, advantageous effects and embodiments will not be repeated for the sake of conciseness.

The present invention also relates to an automobile comprising the inventive system as described above. Therefore, an automobile is provided which enables a more convenient interaction between a ride sharing user and user specific functions of the car.

These and further details, advantages and features of the present invention will be described based on embodiments of the invention and by taking reference to the accompanying figures.

Figure 1 shows a system for triggering a user specific function of a motor vehicle according to one embodiment.

Figure 2 shows a schematic block diagram for elucidating an embodiment of the inventive method of triggering a user specific function of a motor vehicle.

Figure 3a shows the position of the height point (H-Point) according to x- and z- axes. Figure 3b shows a function of the selection of an appropriate H-Point according to the user's height.

Figure 3c shows the H-Point based on the seat position according to different car models.

Figure 3d shows an adjustment of the driver seat and the steering wheel.

Figure 4 shows a preferred embodiment the inventive automobile comprising features of the inventive system.

In the following embodiments and the technical background of the present invention are presented in detail by taking reference to accompanying figures Identical or equivalent elements and elements which act identically or equivalently are denoted with the same reference signs. Not in each case of their occurrence a detailed description of the elements and components is repeated.

The depicted and described features and further properties of the invention's embodiments can arbitrarily be isolated and recombined without leaving the gist of the present invention.

In detail, Figure 1 shows the inventive system 1 for triggering a user 2 specific function of a motor vehicle 7. For the sake of clearness, Figure 1 is interrupted by a wavy line on its left side. The motor vehicle 7 can be any motor vehicle which is suitable for ride sharing systems, e.g. a car. All connections between the respective units shown in Figure 1 can be realized by conventional technical means. For the sake of clarity, the inventive system 1 is framed with dashed lines. The touchless and convenient interaction between the ride sharing user 2 and the system 1 is initiated by an infrared camera 4, arranged at the second seat row passenger door 14a of the motor vehicle 7 to recognize the hand vein pattern 3 of the user 2. The infrared camera 4 can include any suitable known technical means. Due to the infrared camera 4, a quick initial interaction of the user with the system 1 is possible.

The infrared camera 4 is connected to an access control unit 5. The access control unit 5 is arranged to receive a set of data 5a representing the data from the camera 4, which represents a hand 3 vein pattern of the user 2, and to compare the set of data 5a with a predefined reference 5b comprising a data of the user 2 specific hand 3 vein pattern. In case the set of data 5a and the predefined reference 5b match, the access control unit 5 sends a control signal to an electronic control unit 6, wherein the control signal includes information about user specific functions, e.g. seat specific settings, stored in the predefined reference 5b. The access control unit 5 can receive the information and the data representing the hand vein pattern included in the predefined reference 5b by any technical means, either from the user or the ride sharing provider. Furthermore, the access control unit 5 can save a plurality of predefined references 5b relating to different users 2. Thus, a variable system 1 can be obtained.

The electronic control unit 6 is connected to an unlock and opening mechanism 15 in the second seat row passenger door 14a of the motor vehicle 7. The unlock and opening mechanism 15 can be any suitable known in the art. In case the hand vein pattern of the predefined reference 5b and the hand vein pattern of the set of data 5a from the camera 4 match, the control signal from the access control unit 5 to the electronic control unit 6 also includes the information to unlock and open the second seat row passenger door behind the driver seat 14a. Therefore, a convenient opening interaction for the user is established and damage of a door handle 17 due to frequent use is reduced.

The electronic control unit 6 is further connected to seat specific control units (8a, 8b), wherein seat specific control unit 8a is connected to the seat 13. For the sake of clearness, the connections of the seat specific control unit 8a to further user specific functions, comprising seat 13 specific settings, of a second seat row passenger seat behind the co-driver seat 13 are only implied by dotted lines. The seat specific control unit 8b is arranged to adjust a seat specific setting in accordance with the information stored in the predefined reference 5b. The seat specific settings include the second seat row passenger seat behind the driver seat position, a predetermined setting of the air condition 10, an audio system 1 1 setting and/or a setting of an entertainment system 9. The audio system 1 1 can include any known suitable audio system 1 1 known in the art. The entertainment system 9 can for example include an interface for a data connection of the user 2 with his/her electronic device (not shown), e.g. a smart phone to the internet or a ride sharing provider specific platform, including e.g. a virtual shop or a video stream. This provides increased convenience for the user 2.

The system 1 includes any energy source 16 which is suitable. This can for example be the battery of the motor vehicle 7 or an own battery for the system 1 or other suitable known technical means.

Therefore, a system 1 for triggering the user 2 specific function of a motor vehicle 7 is provided which provides an increased convenience, a quick and efficient recognition, high variability and less maintaining costs due to the prevention of damage to the door handles 17.

In detail, Figure 2 shows a schematic block diagram of the inventive method of triggering a user 2 specific function of a motor vehicle 7. A first step 100 includes a touchless detecting of a hand vein pattern 3 of a user 2 next to the motor vehicle 7. Therefore, a facile initial interaction is provided. A second step 200 includes receiving a set of data 5a representing the hand vein pattern of the user 2. A third step 300 includes comparing of the set of data 5a representing the hand 3 of the user 2 with a predefined reference 5b. A fourth step 400 comprises sending the control signal, if the set of data 5a representing the hand vein pattern of the user 2 and the predefined reference 5b match. A fifth step 500 includes triggering the user 2 specific functions.

Optimized user specific functions relating to different information of the respective predefined reference 5b of different users 2 can be triggered. A sixth step 600 includes adjusting user 2 specific functions by a predefined reference 5b at the driver seat 19 and the respective driving patterns. Therefore, user 2 specific functions of a first user 2a, i.e. the driver, which include the driver seat 19 position (e.g. the height) and the steering wheel 20 position (also shown in Fig. 3 d) are adjusted.

A seventh step 700 includes triggering the user specific functions for a second user 2b, i.e. the passenger. The user specific functions for the second user 2b which are triggered can include the settings of an entertainment system 9, wherein a data connection with an electronic device (e.g. smart phone) is possible to the entertainment system 9, the adjustment of a temperature by e.g. air condition 10. This enables a convenient interaction for the second user 2b with the user 2 specific functions of the motor vehicle 7, wherein the respective seat 12, 13, 18 position for the second user 2b which can include one of the second row passenger seats 12, 13 or a configuration of the co-driver seat 18 is adjusted.

An eighth step 800a includes triggering the user specific functions, wherein the second user 2b scans his/her hand vein pattern by the infrared camera 4 of the co-driver door 14c and enters the co-driver door 14c and the co-driver seat 18 is adjusted by moving to the rear in order to generate more space for the second user 2b.

An alternative eighth step 800b includes triggering the user specific functions, wherein the second user 2b scans his/her hand 3 vein pattern at the infrared camera 4 of the second seat row passenger door 14d behind the co-driver door 14c and enters the second row passenger door 14d behind the co-driver door 14c and the co-driver seat 18 is adjusted by moving to the front in order to generate more space for the user. Thus, a more convenient ride is possible for the second user 2b. The alternative is described for a motor vehicle 7 with a left- handed wheel. For a motor vehicle 7 with a right-handed wheel, the description relates to the other second seat row passenger door 14a.

Therefore, a method is provided for optimized triggering of user 2 specific functions relating to different information of the predefined reference 5b which additionally facilitates the interaction between several users (2a, 2b) and the user specific function of the motor vehicle 7. Thus, although several users (2a, 2b) are in the car, the interaction for them with the user 2 specific functions is still convenient.

Furthermore, the user specific functions relate to the respective seat position can be adapted to any user 2 and to any type of motor vehicle 7. An example is given in Figures 3a to 3c relating to the height of the respective seat position. Figure 3a shows the leg of the user 2 in the motor vehicle 7 coordinate system. The height point (H-Point) is the distance from the bottom of the motor vehicle 7 to the middle of the hip of the user 2. Figure 3b shows an optimized function to select an appropriate H-Point for a convenient sitting with an example of user 2 with a height of 176 cm. Figure 3c shows different optimized functions for the H-Point regarding different types of motor vehicles, e.g. SUV, Sedan or a Sports Car. Those data and optimized functions are stored and can be processed in the access control unit 5.

Hereby, the size, volume or geometry of the motor vehicle is not critical, since the access control unit 5 can easily adapt the settings to the height of the user 2. The user 2 can for example enter his preferred settings into a user 2 interface of the ride sharing provider, e.g. over the smart phone or over a computer via the internet.

Fig. 4 shows a preferred embodiment of an automobile 21 comprising features of the inventive system 1 . For the sake of simplicity, the whole system 1 is only implied by dashed lines. In said preferred embodiment cameras are arranged at all doors (14a, 14b, 14c, 14d) of the automobile 21 , namely the driver door 14b and the passenger doors 14c, 14d, 14a.

Thus, an automobile 21 , can be provided which includes all the benefits of the inventive system 1 .

List of reference signs:

1 system

2 user

3 hand

4 camera

5 access control unit

5a set of data

5b predefined reference

6 electronic control unit

7 motor vehicle

8a seat specific control unit

8b seat specific control unit

9 entertainment system

10 air condition

1 1 audio system

12 second seat row passenger seat behind the driver seat

13 second seat row passenger seat behind the co-driver seat

14 door of the motor vehicle

14a second seat row passenger door behind the driver door

14b driver door

14c co-driver door

14d second seat row passenger door behind the co-driver door

15 unlock and opening mechanism

16 energy source

17 door handle

18 co-driver seat

19 driver seat

20 steering wheel

21 automobile

100-800b method steps 800b alternative step of a method

Claims

Claims:

1 . A system (1 ) for triggering a user (2) specific function of a motor vehicle (7), comprising: an access control unit (5) connected to a camera (4) which is arranged at a door (14) of the motor vehicle (7) to recognize a hand (3) of a user (2) next to the motor vehicle (7), wherein the access control unit (7) is arranged to receive a set of data (5a) representing the hand (3) of the user (2) and the data from the camera (4) and to compare the set of data (5a) with a predefined reference (5b) and, in case the set of data (5a) matches with the predefined reference (5b), to send a control signal to an electronic control unit (6) of the motor vehicle (7), wherein the camera (4) is arranged at at least one passenger door (14a, 14c, 14d).

2. The system of claim 1 , wherein the camera (4) includes an infrared camera (4).

3. The system of claim 1 or 2, wherein the system is arranged to adjust the settings for a seat (12, 13, 18) and a periphery of the seat (12, 13, 18) according to preferred settings of the user (2), after the control signal is sent.

4. The system according to any of the preceding claims, wherein the

passenger door (14a, 14c, 14d) is a co-driver door (14c) and/or a second seat row door (14a, 14d).

5. The system according to any of the preceding claims, further comprising a camera (4) which is connected to the access control unit (5), wherein said camera (4) is arranged at the driver door (14b).

6. The system according to any of the preceding claims, wherein the predefined reference (5b) comprises information related to a hand (3) vein pattern, a hand (3) geometry or a relation of the finger length of at least two fingers of the hand (3).

7. The system according to any of the preceding claims, wherein all doors (14a, 14b, 14c, 14d) of the motor vehicle (7) comprise the respective camera (4).

8. The system according to any of the preceding claims, wherein the access control unit (5) is capable of saving a plurality of predefined references (5b).

9. The system according to any of the preceding claims, wherein the

electronic control unit (6) is connected to a seat specific control unit (8a, 8b) which is arranged to adjust a seat (12, 13) specific setting in accordance with the predefined reference (5b).

10. The system according to any of the preceding claims, wherein the seat specific (12, 13, 18, 19) setting comprises an adaption of a seat (12, 13, 18, 19) position configuration and/or a predetermined setting of the air condition (10) and/or of a heater and/or an audio system (1 1 ) setting and/or a setting of an entertainment system (9).

1 1 . The system according to any of the preceding claims, wherein predefined references (5b) are associated with a plurality of seat (12, 13, 18, 19) specific settings.

12. The system according to any of the preceding claims, wherein the

electronic control unit (6) is arranged to unlock the respective door (14a, 14b, 14c, 14d).

13. The system according to any of the preceding claims, wherein the

respective camera (4) is arranged in the door handle (17) on the outside.

14. A method of triggering a user specific function of a motor vehicle (7),

comprising: touchless detecting a hand (3) of a user (2) next to the motor vehicle (7); receiving a set of data (5a) representing the hand (3) of the user (2); comparing the set of data (5a) with a predefined reference (5b); sending a control signal, if the predefined reference (5b) and the set of data (5a) representing the hand (3) of the user (2) match; and triggering the user specific function.

15. An automobile (21 ) comprising a system (1 ) according to any of claims 1 to 13.