WO2011155878A1 - A vehicle based display system and a method for operating the same - Google Patents

A vehicle based display system and a method for operating the same Download PDF

Info

Publication number
WO2011155878A1
WO2011155878A1 PCT/SE2010/000164 SE2010000164W WO2011155878A1 WO 2011155878 A1 WO2011155878 A1 WO 2011155878A1 SE 2010000164 W SE2010000164 W SE 2010000164W WO 2011155878 A1 WO2011155878 A1 WO 2011155878A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
driver
vehicle
information
movement
Prior art date
Application number
PCT/SE2010/000164
Other languages
French (fr)
Other versions
WO2011155878A8 (en
Inventor
Fredrik SANDBLOM
Daniel RICKNÄS
Original Assignee
Volvo Lastavagnar Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Volvo Lastavagnar Ab filed Critical Volvo Lastavagnar Ab
Priority to CN2010800673586A priority Critical patent/CN103124943A/en
Priority to EP20100852979 priority patent/EP2580639A4/en
Priority to PCT/SE2010/000164 priority patent/WO2011155878A1/en
Priority to BR112012031410A priority patent/BR112012031410A2/en
Publication of WO2011155878A1 publication Critical patent/WO2011155878A1/en
Publication of WO2011155878A8 publication Critical patent/WO2011155878A8/en

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Arrangement of adaptations of instruments
    • B60K35/10—
    • B60K35/213—
    • B60K35/22—
    • B60K35/285—
    • B60K35/29—
    • B60K35/60—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • B60K2360/149—
    • B60K2360/1526—
    • B60K2360/186—
    • B60K2360/1868—
    • B60K2360/195—
    • B60K2360/21—
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/101—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using cameras with adjustable capturing direction
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking

Definitions

  • the invention relates to a vehicle based display system and a method for operating the same according to the preambles of the independent claims.
  • Motor vehicles are usually equipped with a set of information display devices that include, in general, an analogue or digital instrument panel on which various quantities are displayed such as, for example, vehicle speed, engine speed, fuel level, etc., a number of optical indicators regarding the state of the vehicle indicating, for example, lights on, engine oil level, water coolant temperature, etc., and additional onboard display devices such as, for example, car radio, air-conditioner, navigator, etc.
  • Most of the analogue instruments comprise, for each quantity represented, a mechanical- type indicator needle representing the value of that quantity on an suitable graduated scale, generally consisting of a series of numeric characters of dimensions and style established during the instrument design phase, while the optical indicators generally comprise standard backlit graphical symbols, each indicating a respective state condition of the motor vehicle.
  • each quantity represented is composed of an LCD (Liquid Cristal Display) or a number of light emitting elements ("LED”) that can be selectively illuminated to form numeric characters indicating the value of that quantity in an associated unit of measurement, or sequentially illuminated to form a level indicator for that quantity on a graduated scale similar to that of an analogue instrument.
  • LCD Liquid Cristal Display
  • LED light emitting elements
  • Both types of instruments are usually able to display messages to the driver, for example warnings to indicate to an operator of the vehicle that a particular parameter reading, for example, the speedometer, tachometer, or temperature gage reading exceeds a desirable range.
  • a particular parameter reading for example, the speedometer, tachometer, or temperature gage reading exceeds a desirable range.
  • interactive warning systems that allow the operator of the vehicle to confirm that a message has been detected.
  • specific buttons for example on the steering wheel, can be used for navigation between different functions or different areas of the instrument cluster and for acknowledging messages.
  • speech recognition systems can be used for voice control of various functions in a vehicle and also for acknowledging messages.
  • a system adapted for use in a commercial vehicle should be more user friendly to avoid distraction and to minimize driver workload.
  • EP 1658191 describes a system for controlling a dual-view display in a vehicle in which the view of the driver is monitored and when the driver directs his/her line of view to the display, data relevant to the operation of the vehicle will be visible on the display and data otherwise only viewable by a passenger will be invisible.
  • a vehicle based display system which is characterized by a driver head tracking system with a sensor for monitoring the driver head position, a display for displaying information to a driver of the vehicle, and a control unit for controlling the display to modify displayed information depending on the driver head position.
  • a driver head tracking system for interaction with the display system enables the driver to interface with the display in a user friendly manner.
  • the display is connected to a camera which is provided with means for changing the camera image viewpoint.
  • a display for example, as a rear- view mirror.
  • the display viewpoint image can be modified when a side movement of the head in the transversal direction of the vehicle is detected.
  • the zoom distance of the display image can be modified when a movement of the head in the longitudinal direction of the vehicle is detected.
  • the head tracking system includes means for monitoring driver gaze direction.
  • An even more refined interactive system can be achieved by monitoring eye movement.
  • detection of gaze direction can be used for modification of displayed information, for example can certain information on a display be highlighted when an eye movement away from the display is detected.
  • an eye movement to a certain field of the display may confirm that a message displayed in said field has been viewed by the driver.
  • the display is adapted for displaying information related to vehicle status.
  • Fig. 1 is a schematic side view illustration of a display system according to one embodiment of the invention arranged inside a vehicle; and Fig. 2-4 shows in front view the display cluster of Fig. 1 in three different modes of use. Detailed description of the invention
  • a display system comprising a instrument cluster 10 installed in the dashboard 11 of a vehicle 12 having a windscreen 13.
  • the instrument cluster is connected to a control unit 14 which receives imaging input from a digital image sensor camera 15.
  • the instrument cluster 10 preferably comprises a digital graphics screen, for example an LCD or plasma screen.
  • the camera 15 is adapted to register the position of the driver's head or eye 16a, 16b.
  • the control unit 14 receives image data from the camera 15, analyzes the collected image information and adapts the video signal sent to the digital graphics screen.
  • the eye 16a illustrates a first normal position of the driver's head and a corresponding display view 17a on a virtual instrument cluster 18.
  • the camera 15 detects the head or eye position and a virtual view corresponding to the head position is graphically transmitted by the control unit 14 to the non- virtual instrument cluster 10.
  • Fig. 2 shows an instrument cluster view corresponding to the head position 16a.
  • the instrument cluster provides information regarding vehicle speed and engine speed at the centre of the cluster.
  • Information regarding engine temperature and fuel level is provided at the left side of the cluster.
  • Service information is provided at the right side of the cluster.
  • the eye 16b illustrates a movement of the driver's head towards the instrument cluster 10 in accordance with the arrow 19.
  • the display view 17b on the virtual instrument cluster 18 is moved correspondingly in accordance with the arrow 20.
  • the camera 15 detects the altered head or eye position and this new different virtual view is graphically transmitted by the control unit 14 to the nonvirtual instrument cluster 10.
  • the control unit 14 moves the viewpoint of the digital image downwards as illustrated by the arrow 20 allowing information to be added at the bottom of the cluster screen.
  • Fig. 3 shows the instrument cluster view corresponding to the head position 16b. In this view the information described above has been moved slightly upwards to allow additional information regarding radio station selection and vehicle navigation information to be displayed at the bottom of the instrument display, see arrow 21.
  • the illusion perceived by the driver looking at the display screen and moving the head in the direction of the arrow 19, is that he or she is able to look past the bottom edge into an opening with a larger display screen at the bottom.
  • the vehicle driver can use the display system according to the invention to control the amount of displayed information on the instrument cluster 10 by head movement.
  • the driver head tracking system is provided with means for detecting driver gaze direction, it is possible to add further functionality. For example, if the head tracking system detects that driver gaze direction is aimed at the road ahead, certain information on the instrument cluster can be highlighted. This is illustrated in Fig. 4, where information regarding vehicle speed, engine speed and an important service message (see arrow 22) regarding ABS system function are highlighted. Instead of highlighting information, a detailed image can be modified to be more suited for peripheral view.
  • a series of detected shifts of gaze direction by the driver towards the service message, within a certain time-frame can for example be used as a confirmation that the driver has realized the message.
  • the display system according to the invention can be utilized by the driver to control different functionalities.
  • an enhanced interactive driver environment can be obtained by using the invention.
  • Another possible application of the invention is in the field of mirrors.
  • a heavy commercial vehicle for example a trailer tractor, is usually equipped with a set of adjustable external mirrors allowing the driver to view traffic in neighbouring lanes at the sides and towards the rear of the vehicle.
  • Other mirrors may be arranged at the front and sides of the tractor cab to view the road immediately in front of the vehicle and near its front wheels. All these external mirrors need frequent cleaning to remove contamination.
  • the mirror installations reduce the aerodynamic efficiency of the vehicle.
  • each external mirror element is replaced by a corresponding display inside the cab.
  • An external camera is connected to the display via a control unit.
  • the external camera is controlled via the head tracking system so that the camera viewpoint is changed simulating natural physical viewpoint changes offered when moving the head relative to a conventional fixed mirror surface.
  • a detected side movement of the driver head in the transversal direction of the vehicle modifies the viewpoint angle of the camera and the displayed viewpoint on the display.
  • a detected movement of the driver head in the longitudinal direction of the vehicle modifies the zoom distance of the display image.
  • the head tracking system may also be used for controlling a camera view of the area behind the vehicle when travelling backwards.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Surgery (AREA)
  • Medical Informatics (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Molecular Biology (AREA)
  • General Physics & Mathematics (AREA)
  • Transportation (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • Instrument Panels (AREA)

Abstract

The invention relates to a vehicle based display system, comprising a driver head tracking system with a sensor (15) for monitoring the driver head position and/or gaze direction. The system also comprises a display (10) for displaying information to a driver of the vehicle, and a control unit (14) for controlling the display (10) to modify displayed information depending on the driver head position. The invention also relates to a method for operating the display system.

Description

A vehicle based display system and a method for operating the same
Background of the invention
The invention relates to a vehicle based display system and a method for operating the same according to the preambles of the independent claims.
Motor vehicles are usually equipped with a set of information display devices that include, in general, an analogue or digital instrument panel on which various quantities are displayed such as, for example, vehicle speed, engine speed, fuel level, etc., a number of optical indicators regarding the state of the vehicle indicating, for example, lights on, engine oil level, water coolant temperature, etc., and additional onboard display devices such as, for example, car radio, air-conditioner, navigator, etc. Most of the analogue instruments comprise, for each quantity represented, a mechanical- type indicator needle representing the value of that quantity on an suitable graduated scale, generally consisting of a series of numeric characters of dimensions and style established during the instrument design phase, while the optical indicators generally comprise standard backlit graphical symbols, each indicating a respective state condition of the motor vehicle.
Instead, most of the digital instruments form an instrument cluster where each quantity represented is composed of an LCD (Liquid Cristal Display) or a number of light emitting elements ("LED") that can be selectively illuminated to form numeric characters indicating the value of that quantity in an associated unit of measurement, or sequentially illuminated to form a level indicator for that quantity on a graduated scale similar to that of an analogue instrument.
Both types of instruments are usually able to display messages to the driver, for example warnings to indicate to an operator of the vehicle that a particular parameter reading, for example, the speedometer, tachometer, or temperature gage reading exceeds a desirable range. With so much information available to the operator of the vehicle, it is desirable to have interactive warning systems that allow the operator of the vehicle to confirm that a message has been detected. According to prior art, specific buttons, for example on the steering wheel, can be used for navigation between different functions or different areas of the instrument cluster and for acknowledging messages. Alternatively, speech recognition systems can be used for voice control of various functions in a vehicle and also for acknowledging messages.
However, these prior art interactive systems can be complicated to use. Preferably, a system adapted for use in a commercial vehicle should be more user friendly to avoid distraction and to minimize driver workload.
EP 1658191 describes a system for controlling a dual-view display in a vehicle in which the view of the driver is monitored and when the driver directs his/her line of view to the display, data relevant to the operation of the vehicle will be visible on the display and data otherwise only viewable by a passenger will be invisible.
Summary of the invention
It is an object of the invention to provide a vehicle based display system and a method for operating the same which enables the operator to interact with the display clusters of a vehicle without the problems described above.
This object is achieved by the features of the independent claims. The other claims and the description disclose advantageous embodiments of the invention.
According to the invention, a vehicle based display system is proposed which is characterized by a driver head tracking system with a sensor for monitoring the driver head position, a display for displaying information to a driver of the vehicle, and a control unit for controlling the display to modify displayed information depending on the driver head position. The use of a driver head tracking system for interaction with the display system enables the driver to interface with the display in a user friendly manner.
According to one embodiment of the invention, the display is connected to a camera which is provided with means for changing the camera image viewpoint. This enables the driver to use a display, for example, as a rear- view mirror. For example, the display viewpoint image can be modified when a side movement of the head in the transversal direction of the vehicle is detected. Also, the zoom distance of the display image can be modified when a movement of the head in the longitudinal direction of the vehicle is detected.
According to another embodiment of the invention, the head tracking system includes means for monitoring driver gaze direction. An even more refined interactive system can be achieved by monitoring eye movement. Thus, detection of gaze direction can be used for modification of displayed information, for example can certain information on a display be highlighted when an eye movement away from the display is detected.
Alternatively or additionally, an eye movement to a certain field of the display may confirm that a message displayed in said field has been viewed by the driver.
Preferably, the display is adapted for displaying information related to vehicle status.
Brief description of the drawings
Fig. 1 is a schematic side view illustration of a display system according to one embodiment of the invention arranged inside a vehicle; and Fig. 2-4 shows in front view the display cluster of Fig. 1 in three different modes of use. Detailed description of the invention
In the drawings, equal or similar elements are referred to by equal reference numerals. The drawings are merely schematic representations, not intended to portray specific parameters of the invention. Moreover, the drawings are intended to depict only typical embodiments of the invention and therefore should not be considered as limiting the scope of the invention.
For explaining the invention, an embodiment of a display system is depicted in Fig. 1, comprising a instrument cluster 10 installed in the dashboard 11 of a vehicle 12 having a windscreen 13. The instrument cluster is connected to a control unit 14 which receives imaging input from a digital image sensor camera 15. The instrument cluster 10 preferably comprises a digital graphics screen, for example an LCD or plasma screen. The camera 15 is adapted to register the position of the driver's head or eye 16a, 16b. The control unit 14 receives image data from the camera 15, analyzes the collected image information and adapts the video signal sent to the digital graphics screen. In Fig. 1, the eye 16a illustrates a first normal position of the driver's head and a corresponding display view 17a on a virtual instrument cluster 18. The camera 15 detects the head or eye position and a virtual view corresponding to the head position is graphically transmitted by the control unit 14 to the non- virtual instrument cluster 10. Fig. 2 shows an instrument cluster view corresponding to the head position 16a. In this view the instrument cluster provides information regarding vehicle speed and engine speed at the centre of the cluster. Information regarding engine temperature and fuel level is provided at the left side of the cluster. Service information is provided at the right side of the cluster.
In Fig. 1, the eye 16b illustrates a movement of the driver's head towards the instrument cluster 10 in accordance with the arrow 19. In this second position of the driver's head the display view 17b on the virtual instrument cluster 18 is moved correspondingly in accordance with the arrow 20. The camera 15 detects the altered head or eye position and this new different virtual view is graphically transmitted by the control unit 14 to the nonvirtual instrument cluster 10. Preferably, the control unit 14 moves the viewpoint of the digital image downwards as illustrated by the arrow 20 allowing information to be added at the bottom of the cluster screen. Fig. 3 shows the instrument cluster view corresponding to the head position 16b. In this view the information described above has been moved slightly upwards to allow additional information regarding radio station selection and vehicle navigation information to be displayed at the bottom of the instrument display, see arrow 21.
Thus, the illusion perceived by the driver looking at the display screen and moving the head in the direction of the arrow 19, is that he or she is able to look past the bottom edge into an opening with a larger display screen at the bottom. Hence, the vehicle driver can use the display system according to the invention to control the amount of displayed information on the instrument cluster 10 by head movement. If the driver head tracking system is provided with means for detecting driver gaze direction, it is possible to add further functionality. For example, if the head tracking system detects that driver gaze direction is aimed at the road ahead, certain information on the instrument cluster can be highlighted. This is illustrated in Fig. 4, where information regarding vehicle speed, engine speed and an important service message (see arrow 22) regarding ABS system function are highlighted. Instead of highlighting information, a detailed image can be modified to be more suited for peripheral view.
Additionally, a series of detected shifts of gaze direction by the driver towards the service message, within a certain time-frame, can for example be used as a confirmation that the driver has realized the message. Thus, the display system according to the invention can be utilized by the driver to control different functionalities. Hence, an enhanced interactive driver environment can be obtained by using the invention. Another possible application of the invention is in the field of mirrors. A heavy commercial vehicle, for example a trailer tractor, is usually equipped with a set of adjustable external mirrors allowing the driver to view traffic in neighbouring lanes at the sides and towards the rear of the vehicle. Other mirrors may be arranged at the front and sides of the tractor cab to view the road immediately in front of the vehicle and near its front wheels. All these external mirrors need frequent cleaning to remove contamination. The mirror installations reduce the aerodynamic efficiency of the vehicle.
According to the invention, each external mirror element is replaced by a corresponding display inside the cab. An external camera is connected to the display via a control unit. The external camera is controlled via the head tracking system so that the camera viewpoint is changed simulating natural physical viewpoint changes offered when moving the head relative to a conventional fixed mirror surface. Preferably, a detected side movement of the driver head in the transversal direction of the vehicle modifies the viewpoint angle of the camera and the displayed viewpoint on the display. In the same manner can a detected movement of the driver head in the longitudinal direction of the vehicle modifies the zoom distance of the display image. The head tracking system may also be used for controlling a camera view of the area behind the vehicle when travelling backwards. The arrangement and method according to the invention reduces driver workload and increases traffic safety. The invention is not to be regarded as being limited to the embodiments described above, a number of additional variants and modifications being possible within the framework of the following patent claims. The system and the method can, for example, also be used for conferring messages displayed by other means than a digital display screen.

Claims

C L A I M S
1. A vehicle based display system, characterized by
a driver head tracking system with a sensor (15) for monitoring the driver head position,
a display (10) for displaying information to a driver of the vehicle, and a control unit (14) for controlling the display (10) to modify displayed information depending on the driver head position.
The display system according to claim 1, wherein the display (10) is connected to vehicle exterior view camera provided with means for changing the camera image viewpoint.
The display system according to claim 1, wherein the head tracking system includes means for monitoring driver gaze direction.
4. The display system according to claim 3, wherein the control unit (14) for
controlling the display (10) is adapted to modify the displayed information when a certain eye movement is detected.
5. The display system according to claim 4, wherein the control unit (14) is adapted to regard an eye movement to a certain field of the display (10) as a confirmation that information in said field has been viewed by the driver.
6. A method for operating a vehicle based display system (10) according to one of the preceding claims, characterized by
detecting a movement of the vehicle driver head position or gaze direction, and
controlling a display for displaying information to a driver of the vehicle to modify the displayed information when a certain head movement is detected.
7. The method according to claim 6, wherein the display (10) is adapted for displaying information related to vehicle status.
8. The method according to claim 7, wherein a detected forward movement of the driver head in the longitudinal direction of the vehicle adds information to the display.
9. The method according to claim 8, wherein the information is added at the bottom field of the display (10).
10. The method according to claim 6, wherein the display is adapted for displaying a vehicle exterior view image.
11. The method according to claim 10, wherein a detected side movement of the driver head in the transversal direction of the vehicle modifies the viewpoint angle of the camera and the displayed viewpoint on the display .
12. The method according to claim 10 or 11 , wherein a detected movement of the driver head in the longitudinal direction of the vehicle modifies the zoom distance of the display image.
13. The method according to claim 6, further characterized by monitoring driver eye (16a, 16b) movement and modifying the displayed information when a certain eye movement is detected.
14. The method according to claim 13 , wherein information on the display ( 10) is highlighted when an eye movement away from the display is detected.
15. The method according to claims 13 or 14, wherein an eye movement to a certain field of the display (10) confirms that a message displayed in said field has been viewed by the driver.
PCT/SE2010/000164 2010-06-10 2010-06-10 A vehicle based display system and a method for operating the same WO2011155878A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN2010800673586A CN103124943A (en) 2010-06-10 2010-06-10 A vehicle based display system and a method for operating the same
EP20100852979 EP2580639A4 (en) 2010-06-10 2010-06-10 A vehicle based display system and a method for operating the same
PCT/SE2010/000164 WO2011155878A1 (en) 2010-06-10 2010-06-10 A vehicle based display system and a method for operating the same
BR112012031410A BR112012031410A2 (en) 2010-06-10 2010-06-10 a vehicle-based dial system and method for operating it

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/SE2010/000164 WO2011155878A1 (en) 2010-06-10 2010-06-10 A vehicle based display system and a method for operating the same

Publications (2)

Publication Number Publication Date
WO2011155878A1 true WO2011155878A1 (en) 2011-12-15
WO2011155878A8 WO2011155878A8 (en) 2013-01-03

Family

ID=45098292

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2010/000164 WO2011155878A1 (en) 2010-06-10 2010-06-10 A vehicle based display system and a method for operating the same

Country Status (4)

Country Link
EP (1) EP2580639A4 (en)
CN (1) CN103124943A (en)
BR (1) BR112012031410A2 (en)
WO (1) WO2011155878A1 (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013101044A1 (en) * 2011-12-29 2013-07-04 Intel Corporation Systems, methods, and apparatus for controlling devices based on a detected gaze
GB2508860A (en) * 2012-12-13 2014-06-18 Nissan Motor Mfg Uk Ltd Vehicle Rear-View Camera System
EP2753085A1 (en) * 2013-01-08 2014-07-09 QNX Software Systems Limited Image processing for control of point of view
EP2752730A1 (en) 2013-01-08 2014-07-09 Volvo Car Corporation Vehicle display arrangement and vehicle comprising a vehicle display arrangement
DE102013001327A1 (en) 2013-01-26 2014-07-31 Audi Ag Method and display system for viewing direction-dependent scaling of a representation
WO2014204794A1 (en) * 2013-06-21 2014-12-24 Magna Electronics Inc. Vehicle vision system
CN104731320A (en) * 2013-12-20 2015-06-24 卡西欧计算机株式会社 Electronic device, display control method
WO2016125042A1 (en) * 2015-02-02 2016-08-11 International Business Machines Corporation Cognitive displays
DE102015203675A1 (en) * 2015-03-02 2016-09-08 Bayerische Motoren Werke Aktiengesellschaft User interface and method for selecting a display element on a user interface
GB2536882A (en) * 2015-03-26 2016-10-05 Denso Corp Head up display adjustment
US20160288717A1 (en) * 2013-03-29 2016-10-06 Aisin Seiki Kabushiki Kaisha Image display control apparatus, image display system and display unit
US20160355133A1 (en) * 2015-06-02 2016-12-08 Lg Electronics Inc. Vehicle Display Apparatus And Vehicle Including The Same
WO2018144130A1 (en) * 2017-02-03 2018-08-09 Qualcomm Incorporated Maintaining occupant awareness in vehicles
US10127463B2 (en) 2014-11-21 2018-11-13 Magna Electronics Inc. Vehicle vision system with multiple cameras
EP3466762A1 (en) * 2017-10-05 2019-04-10 Ningbo Geely Automobile Research & Development Co. Ltd. A monitoring system and method for displaying one or more image views to a user of a vehicle
US10525883B2 (en) 2014-06-13 2020-01-07 Magna Electronics Inc. Vehicle vision system with panoramic view
US10726576B2 (en) 2016-06-29 2020-07-28 Seeing Machines Limited System and method for identifying a camera pose of a forward facing camera in a vehicle
US11472338B2 (en) 2014-09-15 2022-10-18 Magna Electronics Inc. Method for displaying reduced distortion video images via a vehicular vision system

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104802709A (en) * 2015-03-31 2015-07-29 山东理工大学 Intelligent rearview mirror system
US20160297362A1 (en) * 2015-04-09 2016-10-13 Ford Global Technologies, Llc Vehicle exterior side-camera systems and methods
JP6493361B2 (en) * 2016-04-01 2019-04-03 株式会社デンソー Vehicle device, vehicle program, filter design program
DE102016224246A1 (en) * 2016-12-06 2018-06-07 Volkswagen Aktiengesellschaft Method and apparatus for interacting with a graphical user interface
CN110297325B (en) * 2018-03-22 2023-01-13 蔚来控股有限公司 Augmented reality glasses and system and method for displaying information on vehicle by augmented reality glasses
CN110126740A (en) * 2019-05-29 2019-08-16 辽宁科大物联科技有限公司 A kind of control method and device of automotive electronics rearview mirror
CN110271419A (en) * 2019-06-28 2019-09-24 马瑞利汽车电子(广州)有限公司 A kind of automobile instrument vision-control device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5367315A (en) * 1990-11-15 1994-11-22 Eyetech Corporation Method and apparatus for controlling cursor movement
US5689619A (en) * 1996-08-09 1997-11-18 The United States Of America As Represented By The Secretary Of The Army Eyetracker control of heads-up displays
WO1999056274A1 (en) * 1998-04-28 1999-11-04 Deluca Michael J Vision pointer method and apparatus
US6009210A (en) * 1997-03-05 1999-12-28 Digital Equipment Corporation Hands-free interface to a virtual reality environment using head tracking
US20020041259A1 (en) * 1998-08-05 2002-04-11 John R. Lewis Personal display with vision tracking
JP2008141574A (en) * 2006-12-04 2008-06-19 Denso Corp Viewing aid for vehicle
US20090040196A1 (en) * 2003-08-27 2009-02-12 Bernd Duckstein Method of controlling the display of various data in a vehicle and Opto-acoustic data unit
US7538744B1 (en) * 1999-10-30 2009-05-26 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Method and apparatus for computer-aided determination of viewer's gaze direction

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7920102B2 (en) * 1999-12-15 2011-04-05 Automotive Technologies International, Inc. Vehicular heads-up display system
US6812942B2 (en) * 2000-12-28 2004-11-02 International Business Machines Corporation Context-responsive in-vehicle display system
DE102007025530A1 (en) * 2007-05-31 2008-12-04 Volkswagen Ag Information exchange apparatus and method for communicating information

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5367315A (en) * 1990-11-15 1994-11-22 Eyetech Corporation Method and apparatus for controlling cursor movement
US5689619A (en) * 1996-08-09 1997-11-18 The United States Of America As Represented By The Secretary Of The Army Eyetracker control of heads-up displays
US6009210A (en) * 1997-03-05 1999-12-28 Digital Equipment Corporation Hands-free interface to a virtual reality environment using head tracking
WO1999056274A1 (en) * 1998-04-28 1999-11-04 Deluca Michael J Vision pointer method and apparatus
US20020041259A1 (en) * 1998-08-05 2002-04-11 John R. Lewis Personal display with vision tracking
US7538744B1 (en) * 1999-10-30 2009-05-26 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Method and apparatus for computer-aided determination of viewer's gaze direction
US20090040196A1 (en) * 2003-08-27 2009-02-12 Bernd Duckstein Method of controlling the display of various data in a vehicle and Opto-acoustic data unit
JP2008141574A (en) * 2006-12-04 2008-06-19 Denso Corp Viewing aid for vehicle

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2580639A4 *

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9517776B2 (en) 2011-12-29 2016-12-13 Intel Corporation Systems, methods, and apparatus for controlling devices based on a detected gaze
WO2013101044A1 (en) * 2011-12-29 2013-07-04 Intel Corporation Systems, methods, and apparatus for controlling devices based on a detected gaze
EP2743133A3 (en) * 2012-12-13 2014-11-05 Nissan Motor Manufacturing (UK) Ltd. Camera system
GB2508860A (en) * 2012-12-13 2014-06-18 Nissan Motor Mfg Uk Ltd Vehicle Rear-View Camera System
EP2743133A2 (en) * 2012-12-13 2014-06-18 Nissan Motor Manufacturing (UK) Ltd. Camera system
EP2753085A1 (en) * 2013-01-08 2014-07-09 QNX Software Systems Limited Image processing for control of point of view
EP2752730A1 (en) 2013-01-08 2014-07-09 Volvo Car Corporation Vehicle display arrangement and vehicle comprising a vehicle display arrangement
US20140191965A1 (en) * 2013-01-08 2014-07-10 Qnx Software Systems Limited Remote point of view
DE102013001327A1 (en) 2013-01-26 2014-07-31 Audi Ag Method and display system for viewing direction-dependent scaling of a representation
DE102013001327B4 (en) * 2013-01-26 2017-12-14 Audi Ag Method and display system for viewing direction-dependent scaling of a representation
WO2014114425A1 (en) 2013-01-26 2014-07-31 Audi Ag Method and display system for scaling a representation depending on the line of vision
US20160288717A1 (en) * 2013-03-29 2016-10-06 Aisin Seiki Kabushiki Kaisha Image display control apparatus, image display system and display unit
US10112539B2 (en) * 2013-03-29 2018-10-30 Aisin Seiki Kabushiki Kaisha Image display control apparatus, image display system and display unit for displaying rear-view image based on eye point of a driver or angle of a display device
US10946798B2 (en) 2013-06-21 2021-03-16 Magna Electronics Inc. Vehicle vision system
US11247609B2 (en) 2013-06-21 2022-02-15 Magna Electronics Inc. Vehicular vision system
US11572017B2 (en) 2013-06-21 2023-02-07 Magna Electronics Inc. Vehicular vision system
WO2014204794A1 (en) * 2013-06-21 2014-12-24 Magna Electronics Inc. Vehicle vision system
CN104731320A (en) * 2013-12-20 2015-06-24 卡西欧计算机株式会社 Electronic device, display control method
US10899277B2 (en) 2014-06-13 2021-01-26 Magna Electronics Inc. Vehicular vision system with reduced distortion display
US10525883B2 (en) 2014-06-13 2020-01-07 Magna Electronics Inc. Vehicle vision system with panoramic view
US11472338B2 (en) 2014-09-15 2022-10-18 Magna Electronics Inc. Method for displaying reduced distortion video images via a vehicular vision system
US10354155B2 (en) 2014-11-21 2019-07-16 Manga Electronics Inc. Vehicle vision system with multiple cameras
US10127463B2 (en) 2014-11-21 2018-11-13 Magna Electronics Inc. Vehicle vision system with multiple cameras
US9771083B2 (en) 2015-02-02 2017-09-26 International Business Machines Corporation Cognitive displays
JP2018507130A (en) * 2015-02-02 2018-03-15 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ Cognitive mirror device and method and computer program for controlling the same
US9783204B2 (en) 2015-02-02 2017-10-10 International Business Machines Corporation Cognitive displays
WO2016125042A1 (en) * 2015-02-02 2016-08-11 International Business Machines Corporation Cognitive displays
DE102015203675A1 (en) * 2015-03-02 2016-09-08 Bayerische Motoren Werke Aktiengesellschaft User interface and method for selecting a display element on a user interface
GB2536882B (en) * 2015-03-26 2021-12-22 Denso Corp Head up display adjustment
GB2536882A (en) * 2015-03-26 2016-10-05 Denso Corp Head up display adjustment
EP3100913A3 (en) * 2015-06-02 2017-04-05 Lg Electronics Inc. Vehicle display apparatus and vehicle including the same
US20160355133A1 (en) * 2015-06-02 2016-12-08 Lg Electronics Inc. Vehicle Display Apparatus And Vehicle Including The Same
US10726576B2 (en) 2016-06-29 2020-07-28 Seeing Machines Limited System and method for identifying a camera pose of a forward facing camera in a vehicle
US10082869B2 (en) 2017-02-03 2018-09-25 Qualcomm Incorporated Maintaining occupant awareness in vehicles
WO2018144130A1 (en) * 2017-02-03 2018-08-09 Qualcomm Incorporated Maintaining occupant awareness in vehicles
EP3466762A1 (en) * 2017-10-05 2019-04-10 Ningbo Geely Automobile Research & Development Co. Ltd. A monitoring system and method for displaying one or more image views to a user of a vehicle

Also Published As

Publication number Publication date
EP2580639A4 (en) 2014-06-11
EP2580639A1 (en) 2013-04-17
WO2011155878A8 (en) 2013-01-03
CN103124943A (en) 2013-05-29
BR112012031410A2 (en) 2016-11-08

Similar Documents

Publication Publication Date Title
WO2011155878A1 (en) A vehicle based display system and a method for operating the same
US10019965B2 (en) Vehicle display system having a plurality of color temperature settings
JP5232922B2 (en) Vehicle display device
EP2714456B1 (en) System and method for selectively altering content of a vehicle interface
US8390440B2 (en) Method for displaying a visual warning signal
KR102067667B1 (en) Navigation system and method for navigation
US20170136878A1 (en) Method for operating a motor vehicle in different driving modes, and motor vehicle
KR102000929B1 (en) Mirror replacement system for a vehicle
KR20190110482A (en) Method for calculating a fade-in of additional information for displaying on a display unit, apparatus for performing the method and motor vehicle and computer program
CN111837067A (en) Method for displaying a trajectory ahead of a vehicle or an object by means of a display unit, and device for carrying out the method
JP2008030729A (en) Vehicular display device
CN113924225A (en) Method for correcting a driving direction by means of a driver assistance system in a motor vehicle and control device therefor
JP7058800B2 (en) Display control device, display control method, and display control program
KR20120020745A (en) Display layout method for cluster of vehicle
JP2009006950A (en) Display device for movable body
JP5073703B2 (en) Vehicle display device
US11639181B2 (en) Lead vehicle braking warning system
WO2021132306A1 (en) Display control device, display device, display control method, and program
CN115158343A (en) Dynamic AR prompting
CN116963926A (en) Improved visual display using augmented reality heads-up display
JP2023047175A (en) Display control device for vehicle, display device for vehicle, vehicle, display control method for vehicle, and display control program for vehicle
KR102640693B1 (en) Integrated control system for cluster and hud of vehicles
US11491923B2 (en) Image presentation for vehicles with multiple cameras
WO2024090426A1 (en) Vehicle display device
US20240017613A1 (en) Display device for a vehicle

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201080067358.6

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10852979

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2010852979

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112012031410

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 112012031410

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20121210