EP3670236B1

EP3670236B1 - A vehicle comprising a display device and an electronic control unit

Info

Publication number: EP3670236B1
Application number: EP18213941.0A
Authority: EP
Inventors: Jacques Hélot; Ulrich Müller; Sewon CHUN; Jieun SONG; Soyoung Kim
Original assignee: Audi AG; LG Electronics Inc
Current assignee: Audi AG; LG Electronics Inc
Priority date: 2018-12-19
Filing date: 2018-12-19
Publication date: 2021-07-21
Anticipated expiration: 2038-12-19
Also published as: WO2020127043A1; CN113195287B; CN113195287A; US20220066548A1; EP3670236A1

Description

The invention is concerned with a vehicle comprising a display device and an electronic control unit.
A display device nowadays has become an integral part of a vehicle. A display device usually comprises a graphical user interface (GUI) or a touch screen. A user, who can be a driver of the vehicle can communicate with and/or operate other devices in the vehicle remotely by means of the graphical user interface. In this manner, operating functions or driver assistant functions of the other devices of the vehicle can be made available to the user for selection. Usually, display devices are integrated within a dashboard or within a central console of the vehicle. Furthermore, there is always a need to increase the comfortability or make the driving and travel in the vehicle as pleasant as possible, due to which there are certain graphical user interfaces which are integrated in the window panels of the driver's window. This allows people in the vehicle to be seated more freely, that is not always in the direction of the road but slightly angled towards the window, for example. Furthermore, this enables the user to communicate with the other devices in a comfortable manner, since the user can easily reach the window panel while driving the vehicle. However, when the vehicle seat on which the user is sitting, is adjusted or changed to different position and/or orientation by the user, the graphical user interface of the display device may not be reachable to the user.
Document DE 10 2016 218 602 A1 discloses a display device for an altered perception of the outside world of a vehicle through, for example, a window panel of the vehicle. The vehicle comprises at least one panel which is designed as a display device and, on one hand, can be controlled in such a way that it appears transparent and enables a passenger of the vehicle to visually perceive the outside world, and, on the other hand, can be controlled in such a way that the image contents can be displayed on it. However, an adjustability of the display device comprising a user-interface, with a change in the vehicle seat position and/orientation is not disclosed.
Document DE 10 2014 208 740 A1 discloses a display device having at least one glass panel and a display device coupled to the glass panel, wherein the at least one glass panel and the display device are mechanically connected to one another. However, an adjustability of a position of the display device with a user-interface with a change in the vehicle seat position and/orientation is not disclosed.
Document DE 10 2007 015 877 A1 discloses a detection unit with an interface, where the detection units detects a special adjustment of a vehicle part. An arithmetic and logic unit is provided for positioning of a virtual image as a function of the special adjustment of the vehicle part. An input unit is provided for correction of the position of the virtual image. A memory unit is provided for storage of control data to determine connection between the spatial adjustment of the vehicle part and positioning of the virtual image. However, an integration of the display device into a vehicle part, such a window panel, is not disclosed.
DE102016212813A1 discloses a display device for a vehicle. It is an object of the present invention to provide a vehicle comprising a display device and an electronic control unit which enables a user to obtain a clear and comfortable view of a display content of a graphical user interface of the display device and at the same time that the user is able to reach the graphical user interface in a comfortable manner with respect to the position or orientation of the user seated in the vehicle. The term "clear display" implies that the user can view the display contents in an ergonomically comfortable manner, such that all information of the display content are perceivable by the user.
The object is accomplished by the subject matter of the independent claims. Advantageous developments with convenient and non-trivial further embodiments of the invention are specified in the following description, the dependent claims and the figures.
The invention is based on the realization that a display device should always be at a reachable distance from a user in a vehicle, such that the user can always able to reach, for example by his hand, the display device in a comfortable manner, when required. According to the invention, the vehicle comprises the display device and an electronic control unit. The display device comprises a graphical user interface which is designed to display at least one graphic display object. The at least one graphic display object can be for example, a logo and/or an app and/or an output displaying region of the graphical user interface. The electronic control unit is designed to receive at least one input signal from the user-interface and transmit the at least one input signal to at least one device in the vehicle. The input signal can be provided by the user by means of a touch signal and/or a voice signal and/or a gesture. For example, if the user touches a corresponding app on the graphical user interface, then an input signal is sent by means of the electronic control unit to a corresponding device of the vehicle, for example, an infotainment system, comprising information such as the activation of the infotainment system as desired by the user. The electronic control unit is designed to receive at least one functionality signal from the at least one device in the vehicle and transmit the at least one functionality signal as an output signal to the display device. Hence, the output signal can be outputted through the graphical user interface as a video signal and/or an audio signal and/or a haptic signal corresponding to the input signal that had been sent by the user through the graphical user interface.
According to the invention, the electronic control unit is designed to receive an orientation signal of at least one vehicle element. The orientation signal comprises information about a position and/or an orientation of the at least one vehicle element being in a first element position and/or orientation. The at least one vehicle element can be, for example, a steering wheel and/or a vehicle seat and/or a rearview mirror inside the vehicle and/or a rearview mirror outside the vehicle. The orientation and/or position of the at least one vehicle element can be adjusted by the user according to his convenience and/or position and/or size. The information regarding the size and/or position of the user can be estimated by means of the position and/or orientation of the aforementioned at least one vehicle element in a first element position and/or orientation. Furthermore, the electronic control unit is designed to adjust a position of the graphical user interface as a function of the orientation signal of the at least one vehicle element, such that a relative position of the graphical user interface relative to the at least one vehicle element lies within a predefined tolerance. In other words, the electronic control unit is designed to adjust the position of the graphical user interface, such the graphical user interface is always positioned or lies within a predefined tolerance from the vehicle element. Hence, the electronic control unit is designed to determine a position and/or orientation of the user through the determination of the position and/or orientation of the at least one vehicle element and adjusts the position of the graphical user interface accordingly, such that the graphical user interface is at a readable position of the user. This is of advantage, because this ensures that the graphical user interface is of a constant position or distance, such that the user can have a comfortable access of the display contents of the graphical user interface and/or the user can have a comfortable reachability of the graphical user interface of the display device. Furthermore, in case of autonomous driving or self-driving of the vehicle, the vehicle seat can be displaced by a larger distances, such as 70 to 80 cm, moreover, in the case of autonomous driving, the user doesn't have to sit in the direction of travel facing the windscreen, instead the user can be angled, for example towards a window panel of a door of the vehicle. In this case, the present inventions offers the advantage, that the graphical user interface can be adjusted to a new position accordingly, so that the graphical user interface can be comfortably accessed by the user sitting on the vehicle seat. Hence, a direct coupling between the graphical user interface and the at least one vehicle element can be realized.
The invention also comprises embodiments that provide features which afford additional technical advantages.
In one embodiment, the graphical user interface can comprise a display surface comprising a pixel matrix. The display surface, for example is designed as a transparent screen with a large number of monochromatic organic light emitting diodes (OLED). The organic light emitting diodes can be distributed over a total area of the transparent screen. Furthermore, the display surface can be designed as a transparent screen with a large number of transparent organic light emitting diodes (TOLED). The display surface can be a so called polymer display liquid crystal screen (PDLC) or a thin-film transistor screen (TFT), which can used during daytime, when there is a light shining into the vehicle. In a non-actuated state each pixel element of the display surface can remain transparent. This is of advantage, because this enables a formation of a display output signal which can be perceived by the user in a pleasant and comfortable manner.
In one embodiment, the display device can comprise a control circuitry, wherein the control circuitry can be designed to actuate at least one pixel element of the pixel matrix for displaying the at least one graphic display object, wherein in a non-actuated state each pixel element is transparent. In other words, the control circuitry can control an actuation of the pixel elements at a location or position corresponding to the at least on graphic display object, so that the at least one graphic display object can be displayed on the graphical user interface for the user. If at a point of time, a graphic display object is needed to be displayed on a particular location on the graphical user interface, the control circuitry can actuate a plurality of pixel elements at that particular location, which in turn enables the plurality of pixel elements at that particular location of the display surface of the graphical user interface to radiate a monochromatic or a polychromatic corresponding to the at least one graphic display object. However, the other pixel elements can correspond to a non-actuated state and hence remain transparent, for example about 70-90 percent transparent. This enables the rest of the display surface, which is not occupied by the at least one graphic display object to remain transparent. This is of advantage, because this enables the graphical user interface to be integrated in at least one transparent element of the vehicle, such as in front of a wind screen or a window panel, since the user can be able to view the environment outside the vehicle through the transparent elements and at the same time can also have an access to the display contents displayed by the graphical user interface, which is integrated into the transparent element. Furthermore, a movement of the graphical user interface, in order to adjust the position of the graphical user interface, is achieved by shifting an actuation of pixel elements of the pixel matrix. In other words, the electronic control unit receives the orientation signal of the at least one vehicle element and signals to the control circuitry of the display device, which in turn adjusts the activation of the pixel elements of the pixel matrix of the display surface as a function of the orientation signal. Hence, an adjustment of the position of the graphical user interface can be achieved by shifting the activation of the pixel elements without any mechanical movement of the graphical user interface or the display device. This is of advantage, because this enables a robust and stable adjustment of the position of the graphical user interface in accordance with the position and/or orientation of the at least one vehicle element.
In one embodiment, the graphical user interface is integrated into a window panel of a door of the vehicle, such that the graphical user interface occupies at least a part of the window panel. The window panel can be in form of a glass panel, that is the window panel can be transparent or almost transparent. In other words, the graphical user interface can be a part of the window panel which is transparent in itself, since the graphical user interface comprises pixel elements which in the non-actuated state can be transparent and when being actuated by the control circuitry the pixel elements of the pixel matrix emit light to display the at least one graphic display object. This enables the user in the vehicle to have an access to the graphical user interface which is integrated into the window panel of the door of the vehicle comfortably, since it is at a very reachable distance from where the user is seated in the vehicle and at the same time due to the nature of the graphical user interface the user can also access the view of the environment outside of the vehicle through the transparent screen of the graphical user interface.
In one embodiment, the at least one vehicle element is a vehicle seat. This is of advantage, because the information regarding the position and/or orientation of the vehicle seat can provide information regarding the position and/or orientation of the user sitting on the vehicle seat. Hence, the electronic control unit based on the orientation signal comprising the aforementioned information can adjust the position of the graphical user interface accordingly. In other words, the graphical user interface can be adjusted at a distance which is close enough to the user sitting on the vehicle seat, such that the user can have a comfortable and clear access of the display contents on the graphical user interface and at the same time have a clear and comfortable accessibility for accessing different functionalities offered by the graphical user interface of the display device.
In one embodiment, the electronic control unit is designed to compute an estimated head position of the head of the user sitting on the vehicle seat from the orientation signal of the vehicle seat. A rotation of the seat or of the head of the user sitting on the vehicle seat about an axis which is orthogonal to a plane of a vehicle floor can be taken into account for the adjustment of the positioning of the graphical user interface. Furthermore, the electronic control unit is designed to adjust the position of the graphical user interface in accordance with the estimated head position, such that the relative position of the graphical user interface relative to the estimated head position lies within the predefined tolerance. In other words, a vehicle seat which usually comprises of the three main parts, such as the headrest, the backrest and the seat area, each of the aforementioned parts can be adjusted according to the comfort and/or position and/or size of the user by means of the actuators or the servomotors which can be integrated into the vehicle seat. That is, on the basis of the actuators or the servomotors, the user can adjust the position of the headrest, the backrest and the seat area and hence, can change the position and/or orientation of the vehicle seat accordingly. Based on the position and/orientation of each of the aforementioned seat parts of the vehicle seat, the electronic control unit can compute and determine an estimated head position of the head of the user seated on the corresponding vehicle seat. This is of advantage, because based on the estimated head position the electronic control unit can adjust the position of the graphical user interface, such that the relative position of the graphical user interface relative to the estimated head position of the user lies within a predefined tolerance. In other words, the graphical user interface can be adjusted to a position or distance from the estimated head position of the user, such that the user can have a clear accessibility of the display contents of the graphical user interface and/or at the same time, the user can be able to access different functionalities of the graphical user interface by providing input signals, for example by means of touch by his hand, on the graphical user interface. Hence, the user can easily reach the graphical user interface while being seated on the corresponding vehicle seat.
In one embodiment, the display device is attached to an edge of the window panel of the door of the vehicle by means of an holding arrangement, wherein the holding arrangement can be designed to be movable. In other words, the holding arrangement can be in form of a mechanical rack or a ribbon-like structure which can be attached or arranged alongside the edge, for example beneath the window panel of the door of the vehicle, such that the graphical user interface is attached by means of the holding arrangement. The electronic control unit can be designed to move the holding arrangement upon receiving the orientation signal from the at least one vehicle element, such that the display device, which can held by the holding arrangement, can be moved or displaced from one position to the other as per the orientation signal received by the electronic control unit. This is of advantage, because this enables a simple and robust holding arrangement by means of which the display device can be easily adjusted from one position to another by means of the electronic control unit, such that the relative position of the graphical user interface relative to the at least one vehicle element lies within the predefined tolerance.
In one embodiment, the vehicle can comprise a gaze monitoring unit which can be designed to monitor a position and/or orientation of the head of the user. The electronic control unit can be designed to adjust the position of the graphical user interface in accordance with the monitored position and/or orientation of the head of the user, wherein a correction vector for correcting the information from the orientation signal is estimated, such that the relative position of the graphical user interface relative to the head of the user lies within a predefined tolerance. For example, the vehicle may comprise a camera which can be enabled to monitor the position and/or orientation of the head of the user, such that the camera can send a view signal to the electronic control unit. After receiving the view signal, the electronic control unit can calculate the correction vector to determine a corrected position and/or orientation of the head of the user, for example a relative position and/or orientation of the head of the user relative to the headrest of the vehicle seat. The information of the orientation signal can be corrected on the basis of the correction vector. Hence, the electronic control unit can adjust the position of the graphical user interface in accordance of the monitored position and/or orientation of the head of the user. This can enable the placement of the graphical user interface at the position which can be easily and comfortably be accessed by the user while driving the vehicle or being seated on the vehicle seat. Furthermore, this can help in a quicker adjustment of the position of the graphical user interface by means of the electronic control unit as per the view signal provided by the camera.
In one embodiment, the electronic control unit can be designed to receive an adjustment signal for the at least one vehicle element, wherein the adjustment signal is received from the user through the user-interface, wherein the adjustment signal can comprise information about a desired position and/or orientation of the at least one vehicle element. In other words, a position and/or an orientation of a vehicle element, such as the vehicle seat and/or the steering wheel and/or the rearview mirror in the interior of the vehicle and/or the rearview mirror outside of the vehicle can be adjusted by means of the adjustment signal which can be provided by the user to the graphical user interface or the user-interface. For example, the position of the vehicle seat, that is the position of the headrest and/or the backrest and/or the seat area can be arranged or adjusted by means of the adjustment signal. For example, the graphical user interface can display a logo of a structure of a vehicle seat comprising of three parts, such as the headrest, backrest and seat area. The user can adjust the position and/or orientation of each part of the vehicle seat, for example by a swiping movement of his finger while touching the respective logo on the graphical user interface, to a desired position and/or orientation in which he seems or feels comfortable for himself. Based on the adjustment signal, the electronic control unit can send the adjustment signal to the vehicle seat which can enable the actuators or the servomotors to displace the vehicle seat from the first element position to the desired element position, as desired by the user. Furthermore, the electronic control unit can be designed to adjust the position and/or orientation of the at least one vehicle element from the first element position and/or orientation to a desired element position and/or orientation in accordance with the adjustment signal for the at least one vehicle element. This is of advantage, because this enables the a comfortable adjustment of the at least one vehicle element, for example the vehicle seat and/or the steering wheel, by the user by means of the adjustment signal through the graphical user interface of the display device. Other functionalities such as media/navigation or car settings can also be controlled.
In one embodiment, during and/or after the adjusting of the position and/or orientation of the at least one vehicle element from the first element position and/or orientation to the desired element position and/or orientation as a function of the adjustment signal for the at least one vehicle element, the electronic control unit can be designed to receive the orientation signal of the at least one vehicle element, wherein the orientation signal comprises information about the position and/or orientation of the at least one vehicle element in the desired element position and/or orientation. Furthermore, the electronic control unit is designed to adjust the position of the graphical user interface as a function of the orientation signal of the at least one vehicle element, such that the relative position of the graphical user interface relative to the at least one vehicle element in the desired element position and/or orientation lies within the predefined tolerance. In other words, the adjustment of the position of the graphical user interface during the adjustment of the position and/or orientation of the at least one vehicle element can be performed dynamically and/or in real time, so that the relative position of the graphical user interface relative to the at least one vehicle element in the desired position and/or orientation lies within the predefined tolerance. This is of advantage, because this enables the user during and/or after the change or adjustment of the position and/or orientation of the vehicle element, to have a comfortable and clear access to the graphical user interface as well as to have an access to the different functionalities offered by the graphical user interface of the display device. It is further thinkable that the electronic control unit can comprises of a storage unit, in which data related to the position and/or orientation of a plurality of the vehicle elements, such as the vehicle seat and/or the steering wheel and/or the rearview mirror in the interior of the vehicle and/or the rearview mirror on the exterior of the vehicle, can be stored as per the user's desire or the user's choice in a user-profile of the user. For example, when the user enters a vehicle, the user can login to his or her profile by means of the graphical user interface or the user-interface of the display device. After logging into the user-profile, the electronic control unit can access the stored user-profile of the corresponding user and obtain the preferred or desired position and/or orientation of the respective vehicle elements and adjust the corresponding vehicle elements accordingly as per the stored user-profile of the corresponding user. This enables an efficient and an automatic adjustment of the different vehicle elements as per the desire of the user. It is further thinkable that the storage unit of the electronic control unit can comprise an artificial neural network algorithm and a data base. The data base can comprise the different predefined positions of the graphical user interface corresponding to a respective position and/or orientation of various vehicle elements as per the user-profile. When the corresponding user adjusts the corresponding vehicle elements to a defined position and/or orientation, then the electronic control unit can access to the data base comprising the corresponding position and/or orientation for each of the corresponding vehicle elements and estimate the position of the graphical user interface accordingly, by means of the artificial neural network algorithm.
The invention also comprises various combinations of the features of the described embodiments, if not stated otherwise.
In the following an exemplary implementation of the invention is described.
The figures show:

Fig. 1: a schematic illustration of an embodiment of the vehicle; and
Fig. 2: a schematic illustration of an embodiment of the vehicle.

In the figures identical reference signs indicate elements that provide the same function.
Fig. 1 shows a schematic illustration of an interior room 11 of a vehicle 10. The vehicle 10 can be manually driven by a user 12 and/or a semiautonomous and/or an autonomous or self-driving vehicle 10. The user 12, who can be the driver of the vehicle 10, can be seated on a vehicle seat 13 and can steer the vehicle 10 manually by means of a steering wheel 14. The vehicle 10 may comprise various vehicle elements 13, 14 and 15, such as the vehicle seat 13, the steering wheel 14 and/or a rearview mirror 15 in the interior room 11 of the vehicle 10. The vehicle seat 13 can be adjustable from a first element position and/or orientation P1 to a desired element position and/or orientation P2, as shown in Fig. 2. Furthermore, the vehicle seat can be rotatable adjusted about an axis orthogonal to the vehicle floor (not shown in the figures)For the sake of understandability, the vehicle element is confined to the vehicle seat 13 in the Fig. 1 and Fig. 2, wherein the first element position and/or orientation P1 may be referred to the first vehicle seat position and/or orientation P1, similarly, the desired element position and/or orientation P2 may be referred for the desired vehicle seat position and/or orientation P2. The vehicle seat 13 can comprise three parts, a headrest 16, a backrest 17 and a seating area 18.
The vehicle seat position and/or orientation may be adjustable in the following manner: the headrest 16 may be height adjustable, as shown by a double sided arrow 19. Furthermore, the headrest 16 may be sideways adjustable, as shown by a double sided arrow 20. The backrest 17 may be sideways adjustable, as shown by a double sided arrow 21 and finally, the seat area 18 may be lengthwise adjustable, as shown by a double sided arrow 22. An adjustment of the headrest 16, the backrest 17 and the seat area 18 may be achieved by means of an activation of actuators S1, S2 and S3 respectively. The activation of the actuator S1 may be realized by a seat control unit 23, which may send a sub-activation signal A1, as shown by an arrow 24 along a path 27. Similarly, the actuator S2 may be actuated by the seat control unit 23, which may send a sub-activation signal A2, as shown by an arrow 25 along a path 28. Finally, the actuator S3 may be actuated by the seat control unit 23, which may send a sub-activation signal A3 along the path 29, as shown by an arrow 26. The sub-activation signals A1, A2, A3 can be sent from the seat control unit 23 to the actuators S1, S2 and S3 either wirelessly or by means of a wired a wired connection.
Furthermore, the vehicle 10 can comprise a display device 30. The display device 30 may comprise a graphical user interface 31, which is designed to function as a user-interface and/or for displaying at least one graphic display object 32, 33, 34, 35 and 36. The graphical user interface 31 may comprise a display surface comprising a pixel matrix. The display device 30 may comprise a control circuitry 37, wherein the control circuitry 37 is designed to actuate at least one pixel element of the pixel matrix for displaying the at least one graphic display object 32, 33, 34, 35 and 36. Furthermore, in a non-actuated state the pixel element may remain transparent. The graphical user interface 31 comprising a display surface can be in form of a TOLED screen or an OLED screen or a PDLC screen or a TFT screen, especially when there ios enough light coming from outside the vehicle. The at least one graphic display object 32, 33, 34, 35 and 36 as shown in Fig. 1 and Fig. 2, can be a digital image of the vehicle seat 13, which is referred to as a digital vehicle seat 32, a first app 33, a second app 34, a third app 35 and an output panel 36. The graphical user interface 31 may be integrated into a window panel 38 of a door 39 of the vehicle 10, such that the graphical user interface 31 can occupy at least a part of the window panel 38. The part of the window panel 38 that is occupied by the graphical user interface 31 is shown by a region surrounded by a dotted line 40, as shown in Fig. 1 and Fig. 2.
Fig. 1 depicts that the user 12 can have a view of the environment outside of the vehicle 10 through the window panel 38, which can be made of glass, which in turn enables the window panel 38 to be transparent. The graphical user interface 31 which may be a TOLED screen can depict the graphic display object 32, 33, 34, 35 and 36 on one side and at the same time the regions of the graphical user interface 31 which are not occupied by the graphic display object 32, 33, 34, 35 and 36 remain transparent. This enables the user 12 to have a view of the environment outside through the graphical user interface 31 which may cover a part of the view of the environment outside the vehicle 10. For example, an outside vehicle V can be seen through the window panel 38 by the user 12. A part of the outside vehicle V can be hidden behind the graphical user interface 31. However, the part of the outside vehicle V that is hidden behind the graphical user interface 31, which itself can be transparent, can be seen by the user 12. The part of the outside vehicle V which can be seen by the user 12 through the graphical user interface is depicted by means of dotted lines for the sake of understandability. Hence, the presence of the graphical user interface 31 does not hinder the user 12 from having a clear view of the environment outside of the vehicle 10 through the window panel 38, as long as not all the pixel elements are on and as long as there are enough transparent areas to look through. At the same time, the graphical user interface 31 enables the user to view the display contents displayed by the graphical user interface 31. Furthermore, at the same time, the user can be able to access different functionalities offered by the graphical user interface 31.
The vehicle 10 can comprise an electronic control unit 41, wherein the electronic control unit 41 may be designed to receive at least one input signal (not shown in the figures) form user 12 through the graphical user interface 31. For example, the user 12 can provide an input signal by means of a touch signal, so that he can access a functionality of a corresponding device. The electronic control unit 41 may be further designed to transmit the input signal to at least one device, for example, an infotainment system or a door locking unit (not shown in the figures), of the vehicle 10 and/or to receive at least one functionality signal (not shown in the figures) from the at least one device in the vehicle 10 and transmit the at least one functionality signal as an output signal (not shown in the figures) to the display device 30. The output signal can be in form of a video signal and/or an audio signal and/or a haptic signal, for example the video signal can be outputted by means of the output panel 36 of the graphical user interface 31.
The electronic control unit 41 is designed to receive an orientation signal X of at least one vehicle element, for example the vehicle seat 13, wherein the orientation signal X comprises information about a position and/or an orientation of the vehicle seat 13 or the at least one vehicle element 13, 14 and 15. The orientation signal X can be sent by the seat control unit 23 to the electronic control unit 41 via a path 42, as shown by an arrow 43. For example, the actuator S1 can send a first sub-orientation signal X1 to the seat control unit 23 via the path 27, as shown by an arrow 44. Similarly, the actuator S2 can send a second sub-orientation signal X2 via the path 28, as shown by an arrow 45. Similarly, the actuator S3 can send a third sub-orientation signal X3 to the seat control unit 23 via the path 29, as shown by an arrow 46. The sub-orientation signal X1 may comprise information of the position and/or orientation of the headrest 16 of the vehicle seat 13 related to a fixed point in the vehicle (not shown in the figures). The second sub-orientation signal X2 may comprise information about the position and/or orientation of the backrest 17 of the vehicle seat 13 with respect to the fixed point in the vehicle and similarly, the third sub orientation signal X3 may comprise information about the orientation and position of the seat area 18 of the vehicle seat 13 in relation to the fixed point in the vehicle. Hence, by means of the three sub-orientation signals X1, X2 and X3, the seat control unit 23 can contain a data file comprising the information about the position and/or orientation of each part of the vehicle seat 13. Hence, the seat control unit 23 can compute to determine the position and/or orientation of the vehicle seat 13.
Fig. 1 shows the first position and/or orientation P1 of the vehicle seat 13. The seat control unit 23 may send the orientation signal X to the electronic control unit 41, wherein the orientation signal X comprises the information derived from the sub-orientation signals X1, X2 and X3. The electronic control unit 41 can further comprise a processor 47 and a storage unit 48, for example, random access memory (RAM), read only memory (ROM), programmable ROM (PROM), firmware, or flash memory. The electronic control unit 41 can further transmit the orientation signal X to the control circuitry 37 of the display device 30, via a path 50, as shown by an arrow 49. Furthermore, the electronic control unit 41 can be designed to adjust a position of the graphical user interface 31 as function of the orientation signal X of the at least one vehicle element 13, 14 and 15, which in this case, is the vehicle seat 13, such that a relative position of the graphical user interface 31 relative to the vehicle seat 13 lies within a predefined tolerance.
As per the embodiment of the display device 30 shown in the Fig. 1 and Fig. 2, the electronic control unit 41 can send the orientation signal X to the control circuitry 37 of the display device 30, which in turn enables an adjustment of the position of the graphical user interface 31 as a function of the orientation signal X of the vehicle seat 13 from a first position Q1, as shown in Fig. 1, to a second position Q2, as shown in Fig. 2. Furthermore, a movement of the graphical user interface 31, in order to adjust the position of the graphical user interface 31, can be achieved by shifting an actuation of pixel elements of the pixel matrix. In other words, the electronic control unit 41 receives the orientation signal X of the at least one vehicle element 13, 14 and 15, which in this case, is the vehicle seat 13, and signals by means of a signal X' to the control circuitry 37 of the display device 30, which in turn adjusts the activation of the pixel elements of the pixel matrix of the display surface as a function of the signal X'. Hence, an adjustment of the position of the graphical user interface 31 can be achieved by shifting the activation of the pixel elements without any mechanical movement of the graphical user interface 31 or the display device 30.
The graphical user interface 31 displays an image of the vehicle seat 13 in form of a digital seat 32. The digital seat 32 comprises three parts analogous to the vehicle seat 13, namely a digital headrest 56 corresponding to the headrest 16, a digital backrest 57 corresponding to the backrest 17 and a digital seat area 58 corresponding to the seat area 18 of the vehicle seat 13. Furthermore, a double sided arrow 51 and a double sided arrow 52 can correspond to the double sided arrows 20 and 19 of the headrest 16 of the vehicle seat 13, respectively. Similarly, a double sided arrow 53 can correspond to the double sided arrow 21 of the backrest 17 of the vehicle seat 13 and finally, a double sided arrow 54 of the digital seat 32 can correspond to the double sided arrow 22 of the seat area 18 of the vehicle seat 13. As depicted in Fig. 1, the user 12, who may be driving the vehicle 10 manually by steering the steering wheel 14, can adjust the position and/or orientation of the vehicle seat 13 by adjusting the position and/or orientation of the digital seat 32 on the graphical user interface 31. The user 12 can provide an input signal, for example a touch signal by means of a finger of his hand 59, such that the user 12 can swipe or move his finger along the direction of the arrows 51, 52, 53, 54 of the digital seat 32 as per his convenience so that the vehicle seat 13 is adjusted from the first position and/orientation P1 to the desired position and/or orientation P2. Furthermore, while the vehicle seat 13 can be moved by touching on the graphical user interface as the graphical user interface moves simultaneously. Furthermore, when a moving distance is short, the graphical user interface can stay for a predefined interval of time at the same position, so that it can be easier to control the graphical user interface and then jump to the next position after the predefined time interval or time out.
The electronic control unit 41 may be designed to receive an activation signal A for the vehicle seat 13, wherein the activation signal A can be received from the user 12 through the graphical user interface 31, wherein the adjustment signal A comprises information about the desired position and/or orientation B2 of the vehicle seat 13, as shown in Fig. 2. The activation signal A may be sent by the control circuitry 37 of the display device 30 to the electronic control unit 41 via the path 50, as shown by an arrow 60. Furthermore, the electronic control unit 41 can send the activation signal A to the seat control unit 23 via the path 42, as shown by an arrow 61. The activation signal A comprises information of the position and/or orientation of the digital seat 32 which corresponds to that of the vehicle seat 13. The activation signal A can comprise information regarding a position and/or orientation of the digital headrest 56 in form of the sub-activation signal A1, information about a position and/or orientation of the digital backrest 57 in form of the sub-activation signal A2 and finally, information about a position and/or orientation of the of digital seat area 58 in form of the sub-activation signal A3. The seat control unit 23 can receive the activation signal A and can extract the respective sub-activation signals A1, A2 and A3 and send the respective sub-activation signals A1, A2 and A3 to the corresponding actuators S1, S2 and S3 respectively. For example, the seat control unit 23 can send the sub-activation signal A1 to the actuator S1, the sub-activation signal A2 to the actuator S2 and the sub-activation signal to the actuator S3. Upon receiving each of the sub-activation signals A1, A2 and A3, the actuators S1, S2 and S3 can adjust the position and/or orientation of the respective parts, that is, the headrest 16, the backrest 17 and the seat area 18 of the vehicle seat 13. Hence, the vehicle seat 13 can be adjusted to the desired position and/or orientation B2 as desired by the user 12. Therefore, the electronic control unit 41 is designed to adjust the position and/or orientation of the at least one vehicle element 13, 14 and 15, which in this case, is the vehicle seat 13 from the first element position and/or orientation B1 to the desired element position and/or orientation B2 as a function of the activation signal A for the vehicle seat 13.
During and/or after the adjusting of the position and/or orientation of the at least one vehicle element 13, 14 and 15, which in this case, is the vehicle seat 13, from the first element position and/or orientation B1 to the desired element position and/or orientation B2 as a function of the activation signal A for the at least one vehicle element 13, the electronic unit 41 is designed to receive the orientation signal X of the at least one vehicle element 13, wherein the orientation signal X comprises information about the orientation and/or position of the at least one vehicle element 13 in the desired position and/or orientation B2. In other words, during and/or after the adjustment of the position and/or orientation of the vehicle seat 13, each of the actuators S1, S2, S3 can send corresponding sub-orientation signals X1, X2, X3 to the seat control unit 23, which comprise new information about the position and/or orientation of each of the parts of the vehicle seat 13, that is the headrest 16, the backrest 17 and the seat area 18. The seat control unit 23 can receive the corresponding sub-orientation signals X1, X2, X3 with the new information about the position and/or orientation of the vehicle seat 13 in the desired position and/or orientation B2 or an intermediate position and/or orientation, which may be intermediate to the first position and/or orientation B1 and the desired positon and/or orientation B2. The seat control unit 23 can then send the orientation signal X with the new information to the electronic control unit 41 via the path 42, as shown by the arrow 43. Furthermore, the electronic control unit 41 may be designed to adjust the position of the graphical user interface 31 from the first position Q1 to a second position Q2 as a function of the orientation signal X of the vehicle seat 13, such that a relative positon of the graphical user interface 31 relative to the vehicle seat 13 in the desired position and/or orientation B2 lies within the predefined tolerance. For example, as shown in Fig. 2, the user 12 can set the vehicle in an autonomous driving mode or a self-driving mode, such that in this case, the user 12 can lay back on the vehicle seat 13 in the new position and/or orientation B2 as shown in the Fig. 2. In this case the graphical user interface 31 is adjusted to the new position Q2, so that the user can have a clear view of the display contents, that is the at least one graphic display object 32, 33, 34 35 and 36, of the graphical user interface 31.
The electronic control unit 41 may be designed to compute an estimated head position H1 of the head of the user 12 sitting on the vehicle seat 13 from the orientation signal X of the vehicle seat 13, wherein the electronic control unit 41 can be designed to adjust the position of the graphical user interface 31 in accordance with the estimated head position H1, such that the relative positon of the graphical user interface 31 relative to the estimated head position H1 lies within the predefined tolerance.
The vehicle 10 may comprise a gaze monitoring unit 62, for example a camera, which can be designed to monitor the position of the head of the user 12, wherein the electronic control unit 41 can be designed to adjust the position of the graphical user interface 31 in accordance with the monitored position and/or orientation of the head of the user 12, wherein a correction vector for correcting the information from the orientation signal X can be estimated, such that the relative position of the graphical user interface 31 relative to the position of the head of the user 12 lies within a predefined tolerance. Furthermore, the display device 30 may be attached to an edge 63 of the window panel 38 of the door 39 of the vehicle 10 by means of a holding arrangement (not shown in the figures), wherein the holding arrangement can be designed to be movable.
Overall, the example shows how the display device 30 enables the display of the at least one graphic display object 32, 33, 34, 35 and 36 in an efficient manner, such that the graphical user interface 31 is coupled to the eat least one vehicle element 13, 14 and 15, which in this case, is the vehicle seat 13. Furthermore, the display device 30 is always maintained at a position and/or orientation which lies within a predefined tolerance from the at least one vehicle element 13, 14 and 15, as it is provided by the invention.

Claims

Vehicle (10) comprising:
- a display device (30) comprising a graphical user interface (31) which is designed to display at least one graphic display object (32, 33, 34, 35, 36) and to receive at least one input signal; and

- an electronic control unit (41) which is designed to receive the at least one input signal from the display device (30) and transmit the input signal to at least one device in the vehicle (10) and/or to receive at least one functionality signal from the at least one device in the vehicle (10) and transmit the at least one functionality signal as an output signal to the display device (30),
characterized in that

- the electronic control unit (41) is designed to receive an orientation signal (X) of at least one vehicle element (13, 14, 15), wherein the orientation signal (X) comprises information about a position and/or an orientation of the at least one vehicle element (13, 14, 15) being in a first element position and/or orientation (P1); and

- the electronic control unit (41) is designed to adjust a position of the graphical user interface (31) as a function of the orientation signal (X) of the at least one vehicle element (13, 14, 15), such that a relative position of the graphical user interface (31) relative to the at least one vehicle element (13, 14, 15) lies within a predefined tolerance.
Vehicle (10) according to claim 1, wherein the graphical user interface (31) comprises a pixel matrix.
Vehicle (10) according to claim 1 or 2, wherein the display device (30) comprises a control circuitry (37), wherein the control circuitry (37) is designed to actuate at least one pixel element of the pixel matrix for displaying the at least one graphic display object (32, 33, 34, 35, 36), wherein in a non-actuated state each pixel element is transparent, wherein a movement of the graphical user interface (31), in order to adjust the position of the graphical user interface (31), is achieved by shifting an actuation of pixel elements of the pixel matrix.
Vehicle (10) according to any of the preceding claims, wherein the graphical user interface (31) is integrated into a window panel (38) of a door (39) of the vehicle (10), such that the graphical user interface (31) occupies at least a part of the window panel (38).
Vehicle (10) according to any of the preceding claims, wherein the at least one vehicle element (13, 14, 15) is a vehicle seat (13).
Vehicle (10) according to claim 5, wherein the electronic control unit (41) is designed to compute an estimated head-position (H) of a head of a user (12) sitting on the vehicle seat (13) from the orientation signal (X) of the vehicle seat (13), wherein the electronic control unit (41) is designed to adjust the position of the graphical user interface (31) in accordance with the estimated head-position (H), such that the relative position of the graphical user interface (31) relative to the estimated head-position (H) lies within a predefined tolerance.
Vehicle (10) according to claim 1, wherein the display device (30) is attached to an edge (63) of a window panel (38) of a door (39) of the vehicle (10) by means of an holding arrangement, wherein the holding arrangement is designed to be movable.
Vehicle (10) according to any of the preceding claims, wherein the vehicle (10) comprises a gaze monitoring unit (62) which is designed to monitor a position and/or orientation of a head of a user (12), wherein the electronic control unit (41) is designed to adjust the position of the graphical user interface (31) in accordance with the monitored position and/or orientation of the head of the user (12), wherein a correction vector for correcting the information from the orientation signal (X) is estimated, such that the relative position of the graphical user interface (31) relative to the head of the user (12) lies within a predefined tolerance.
Vehicle (10) according to any of the preceding claims, wherein
- the electronic control unit (41) is designed to receive an activation signal (A) for the at least one vehicle element (13, 14, 15), wherein the activation signal (A) is received from a user (12) through the graphical user interface (31), wherein the activation signal (A) comprises information about a desired position and/or orientation (P2) of the at least one vehicle element (13, 14, 15); and

- the electronic control unit (41) is designed to adjust the position and/or orientation of the at least one vehicle element (13, 14, 15) from the first element position and/or orientation (P1) to a desired element position and/or orientation (P2) as a function of the activation signal (A) for the at least one vehicle element (13, 14, 15).
Vehicle (10) according to claim 9, wherein
- the electronic control unit (41) is designed to receive the orientation signal (X) of the at least one vehicle element (13, 14, 15) during and/or after the adjusting of the position and/or orientation of the at least one vehicle element (13, 14, 15), wherein the orientation signal (X) comprises information about the position and/or orientation of the at least one vehicle element (13, 14, 15) being in the desired element position and/or orientation (P2); and

- the electronic control unit (41) is designed to adjust the position of the graphical user interface (31) as a function of the orientation signal of the at least one vehicle element (13, 14, 15), such that the relative position of the graphical user interface (31) relative to the at least one vehicle element (13, 14, 15) in the desired element position and/or orientation (P2) lies within the predefined tolerance.