DE102006029847A1 - Night vision system for e.g. car, has computing device calculating representation of image from data of sensors and sensor device such that actual image covers environment with image represented on display - Google Patents

Night vision system for e.g. car, has computing device calculating representation of image from data of sensors and sensor device such that actual image covers environment with image represented on display

Info

Publication number
DE102006029847A1
DE102006029847A1 DE200610029847 DE102006029847A DE102006029847A1 DE 102006029847 A1 DE102006029847 A1 DE 102006029847A1 DE 200610029847 DE200610029847 DE 200610029847 DE 102006029847 A DE102006029847 A DE 102006029847A DE 102006029847 A1 DE102006029847 A1 DE 102006029847A1
Authority
DE
Germany
Prior art keywords
image
display
night vision
vision system
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
DE200610029847
Other languages
German (de)
Inventor
Hubert Adamietz
Manfred Hähl
Lutz Keferstein
Hans-Peter Kreipe
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Continental Automotive GmbH
Original Assignee
Siemens AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG filed Critical Siemens AG
Priority to DE200610029847 priority Critical patent/DE102006029847A1/en
Publication of DE102006029847A1 publication Critical patent/DE102006029847A1/en
Application status is Withdrawn legal-status Critical

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/0093Other optical systems; Other optical apparatus with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B23/00Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/12Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices with means for image conversion or intensification
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/106Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using night vision cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/205Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8053Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for bad weather conditions or night vision
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed
    • G02B2027/0187Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Abstract

The invention relates to a night vision system in which the image of the surroundings of a motor vehicle is recorded by means of a sensor and displayed by means of a display as a display image, wherein the display superimposed on the display image of the view of the environment, wherein a sensor device is present, that the sensor device, the eye position and viewing direction of an observer detects that a computing device calculates the display image from the data of the sensor and the sensor device.

Description

  • The The invention relates to a night vision system in which the image of the environment a motor vehicle is received by means of a sensor and means an ad is displayed as a display image. From the state The technique is known, the image by means of an infrared sensor to record the environment of a motor vehicle and by means of a display display. This display is for example in a display mounted in the center console or in an instrument cluster. in this connection It is disadvantageous for a driver to watch this display his eyes must turn away from the roadway. Therefore, continued developed corresponding night vision systems, in which the display of the Display image of the view of the environment is superimposed. This is For example, in a head-up display in a portion of the Windscreen the recorded image of the sensor. Here, a driver can perceive objects or persons, he by means of existing in the motor vehicle lighting devices can not perceive. A disadvantage of the previously known systems But it is that the driver does not recognize one hundred percent, where the persons and objects displayed in the head-up display are actually located and he thus an assignment of the persons and objects shown to reality carry out got to. The driver thus recognizes that there is an obstacle is, but must still carry out an assignment, which is a corresponding Time is required. This time may be missing to the obstacle yet to dodge. The object of the invention is therefore, this problem of assignment to solve.
  • These Task is solved by that a sensor device is present, that the sensor device the eye position and viewing direction of an observer recorded and that a computing device from the data of the sensor and the sensor device the representation image calculated in such a way that the actual Picture of the environment with the picture displayed on the screen. That's why he knows Motorists exactly where obstacles are and can accordingly react.
  • If the display is designed as a head-up display is the display for the Motorist particularly comfortable, as he has no additional equipment or just carry instruments and just by the windshield can see and thus perceive the image of the environment once real and congruently projected onto the windshield gets.
  • If The display is designed as a near-to-eye display, is a cheap solution possible, there the requirements for the representation of the picture are less than at a head-up display.
  • If the image of the environment is recorded by means of several sensors, the appearance of the environment can be improved even further. If the Sensor is designed as a near-infrared sensor, it can be all physical objects represented by a normal light source or an infrared light source be illuminated. If the sensor designed as a remote infrared sensor is no separate light source is required. The far infrared sensor reacts to thermal radiation of living things and other objects that emit heat radiation. The range a far-infrared sensor is correspondingly high. Especially ideal it is when a near-infrared sensor and a far-infrared sensor simultaneously be used, because then the closer Surrounding the vehicle a full view of obstacles possible is and in the wider environment at least still living things and other sources of heat can be perceived.
  • If a location system is present and three-dimensional map material is available can from the determined location the 3D map material in addition to Representation of the environment can be used. So it is possible, for example a street course to represent for the sensors are not directly visible.
  • If the location system is designed as a satellite navigation system, It is particularly accurate and less prone to failure. If this satellite navigation system designed as a GPS system, is an established, functionally proven system available.
  • Provided the satellite navigation system designed as Galileosatellitensystem is, the navigation can be performed more precisely, as the artificial Worsening of the GPS system in Galileo system not available are.
  • The Invention will be described below with reference to the figures. Show it:
  • 1 a symbolic motor vehicle with a first embodiment of a night vision system according to the invention,
  • 2 a second embodiment, the or the image represented by the night vision system or the images shown.
  • 3 a view from a windshield of the motor vehicle 1 and those in the system 2 displayed information.
  • In 1 you recognize a motor vehicle 1 with a windshield 2 , a computing device 3 , a location device 4 , an infrared headlight 5 , a 3D map material device 6 , a projector 7 a head-up display, a near-infrared sensor 8th and a far-infrared sensor 9 and a sensor device 10 , which detects the eye position and the viewing direction of a driver K. Furthermore one recognizes in 1 a satellite SAT, a tree T and a street ST. The infrared headlight 5 illuminates the environment of the motor vehicle. This infrared radiation is generated by the near-infrared sensor 8th added. Furthermore, the far infrared sensor takes 9 also the parts of the environment, that of the infrared headlight 5 not be irradiated.
  • That of the far infrared sensor 9 and near-infrared sensor 8th captured image of the environment is in the computing device 3 processed. At the same time by means of the sensor device 10 taken the eye position and viewing direction of the driver K and also to the computing device 3 transmitted. The computing device 3 calculated from the above data, the representation of the environmental image by means of the projector 7 on the windshield 2 is projected, so that the image of the near-infrared and far-infrared sensor 8th . 9 recorded image of the environment is superimposed congruent with the real existing image of the environment and the driver so a direct assignment of the near-infrared sensor 8th and remote infrared sensor 9 received living beings and objects receives. The projector 7 is designed to cover the area of the windshield 2 can irradiate, through which the driver K can see, so that a congruent representation is made possible. Furthermore, in 1 the position of the motor vehicle by means of the locating system 4 determined and to the computing device 3 transmitted. The computing device 3 still has access to 3D map material 6 and so can still represent the environment that is not from the near-infrared or far-infrared sensors 8th . 9 be added and thus provide additional information about the environment. For example, the course of the road ST can also be displayed in an area that is not from the sensors 8th . 9 can be included.
  • In 2 is shown a second solution in the form of a near-to-eye system. Shown is only the arithmetic unit 3 and a near-to-eye glasses 11 into which a sensor device, not shown, corresponding to the sensor device 10 out 1 and a double unrepresented projection device according to the projector 7 in 1 are integrated. By means of the double projection device is in each of the spectacle lenses recorded by the sensors and the computing device 6 for each eyeglass separately calculated image mirrored in such a way that for a wearer of the glasses 11 the mirrored image overlaps the image of the environment congruently. So here, too, the driver has no problems of a direct assignment of the living beings and objects.
  • In 3 can be seen a view from the windshield, so the view of the environment, as it results in about a motor vehicle, which is in the in 1 is shown position. Furthermore, one recognizes the near-to-eye glasses 11 and those in the near-to-eye glasses 11 displayed information. Here, the representation of the near-to-eye glasses is chosen so that, according to the viewing direction and eye position of the observer, the image of the environment is brought into line with the image shown.
  • The The above embodiments are easy amended become. So can on a tracking system and a 3D map display be waived. Furthermore, only one sensor is required. If only one or more remote infrared sensors are available, can be dispensed with an infrared lamp. A near-to-eye glasses can also be over for example a Bluetooth or infrared interface be connected to the arithmetic unit.

Claims (10)

  1. Night vision system in which the image of the surroundings of a motor vehicle ( 1 ) by means of a sensor ( 8th . 9 ) and by means of a display ( 7 . 2 ) is displayed as a display image, wherein the display superimposes the display image on the view of the environment, characterized in that a sensor device ( 10 ) is present, that the sensor device ( 10 ) the eye position and viewing direction of an observer (K) detects that a computing device ( 3 ) from the data of the sensor ( 8th . 9 ) and the sensor device ( 10 ) calculates the display image such that the display image of the view of the environment overlaps congruent.
  2. Night vision system according to claim 1, characterized in that the display as a head-up display ( 7 . 10 ) is configured.
  3. Night vision system according to claim 1, characterized in that the display as near-to-eye display ( 11 ) is configured.
  4. Night vision system according to one of the preceding claims, characterized in that the image of the environment by means of several sensors ( 8th . 9 ) is recorded.
  5. Night vision system after one of the protrude the claims, characterized in that the sensor as Naheinfrarotsensor ( 8th ) is configured.
  6. Night vision system according to one of the preceding claims, characterized in that the sensor as a remote infrared sensor ( 9 ) is configured.
  7. Night vision system according to one of the preceding claims, characterized in that a location system ( 4 ) which is additionally used according to the determined location of 3D map material for representing the environment.
  8. Night vision system according to claim 7, characterized in that the location system ( 4 ) is designed as a satellite navigation system.
  9. Night vision system according to claim 8, characterized that the satellite navigation system designed as a GPS system is.
  10. Night vision system according to claim 8, characterized that the satellite navigation system as Galileosatellitensystem is designed.
DE200610029847 2006-06-27 2006-06-27 Night vision system for e.g. car, has computing device calculating representation of image from data of sensors and sensor device such that actual image covers environment with image represented on display Withdrawn DE102006029847A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DE200610029847 DE102006029847A1 (en) 2006-06-27 2006-06-27 Night vision system for e.g. car, has computing device calculating representation of image from data of sensors and sensor device such that actual image covers environment with image represented on display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE200610029847 DE102006029847A1 (en) 2006-06-27 2006-06-27 Night vision system for e.g. car, has computing device calculating representation of image from data of sensors and sensor device such that actual image covers environment with image represented on display

Publications (1)

Publication Number Publication Date
DE102006029847A1 true DE102006029847A1 (en) 2008-01-03

Family

ID=38776870

Family Applications (1)

Application Number Title Priority Date Filing Date
DE200610029847 Withdrawn DE102006029847A1 (en) 2006-06-27 2006-06-27 Night vision system for e.g. car, has computing device calculating representation of image from data of sensors and sensor device such that actual image covers environment with image represented on display

Country Status (1)

Country Link
DE (1) DE102006029847A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009150272A1 (en) * 2008-06-10 2009-12-17 Euroconsult Nuevas Tecnologías, S.A. Equipment for the automatic assessment of road signs and panels
US8629903B2 (en) 2009-04-02 2014-01-14 GM Global Technology Operations LLC Enhanced vision system full-windshield HUD
DE102013206739A1 (en) * 2013-04-16 2014-10-16 Bayerische Motoren Werke Aktiengesellschaft Method for determining whether an occupant of a vehicle notices relevant objects in the vicinity of the vehicle
US8912978B2 (en) 2009-04-02 2014-12-16 GM Global Technology Operations LLC Dynamic vehicle system information on full windshield head-up display
WO2015000693A1 (en) * 2013-07-03 2015-01-08 Bayerische Motoren Werke Aktiengesellschaft Showing of collision warnings on a head-mounted display
DE102013021854A1 (en) * 2013-12-21 2015-06-25 Audi Ag Visual and operating device for carrying out a method for determining a hazard potential in a vehicle
US9162622B2 (en) 2009-04-02 2015-10-20 GM Global Technology Operations LLC Peripheral salient feature enhancement on full-windshield head-up display

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003011722A (en) * 2001-06-29 2003-01-15 Toyota Motor Corp Nighttime running support device
DE10203413A1 (en) * 2002-01-28 2003-08-14 Daimler Chrysler Ag Automobile infrared night vision device
DE10242262A1 (en) * 2002-09-12 2004-03-25 Daimlerchrysler Ag Stereo vision system for assisting night vision in vehicles has arrangement for generating stereoscopic reproduction of image signals acquired by at least two night vision-compatible cameras
DE10302387A1 (en) * 2003-01-22 2004-08-26 Siemens Ag Head up display for motor vehicle divides display image into strips to provide reduction of parallax
DE10336329A1 (en) * 2003-08-07 2005-03-10 Bosch Gmbh Robert Method and device for improving the visibility in a motor vehicle
DE10344120A1 (en) * 2003-09-24 2005-04-21 Daimler Chrysler Ag Device and method for displaying driving instructions
DE102004034358A1 (en) * 2004-07-13 2006-02-09 Volkswagen Ag Head up information display for automobile drivers uses a laser projection onto the windscreen

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003011722A (en) * 2001-06-29 2003-01-15 Toyota Motor Corp Nighttime running support device
DE10203413A1 (en) * 2002-01-28 2003-08-14 Daimler Chrysler Ag Automobile infrared night vision device
DE10242262A1 (en) * 2002-09-12 2004-03-25 Daimlerchrysler Ag Stereo vision system for assisting night vision in vehicles has arrangement for generating stereoscopic reproduction of image signals acquired by at least two night vision-compatible cameras
DE10302387A1 (en) * 2003-01-22 2004-08-26 Siemens Ag Head up display for motor vehicle divides display image into strips to provide reduction of parallax
DE10336329A1 (en) * 2003-08-07 2005-03-10 Bosch Gmbh Robert Method and device for improving the visibility in a motor vehicle
DE10344120A1 (en) * 2003-09-24 2005-04-21 Daimler Chrysler Ag Device and method for displaying driving instructions
DE102004034358A1 (en) * 2004-07-13 2006-02-09 Volkswagen Ag Head up information display for automobile drivers uses a laser projection onto the windscreen

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009150272A1 (en) * 2008-06-10 2009-12-17 Euroconsult Nuevas Tecnologías, S.A. Equipment for the automatic assessment of road signs and panels
ES2354786A1 (en) * 2008-06-10 2011-03-17 Euroconsult Nuevas Tecnologias, S.A. Automatic advisory equipment of traffic signs and panels.
US8629903B2 (en) 2009-04-02 2014-01-14 GM Global Technology Operations LLC Enhanced vision system full-windshield HUD
US8912978B2 (en) 2009-04-02 2014-12-16 GM Global Technology Operations LLC Dynamic vehicle system information on full windshield head-up display
US9162622B2 (en) 2009-04-02 2015-10-20 GM Global Technology Operations LLC Peripheral salient feature enhancement on full-windshield head-up display
DE102013206739A1 (en) * 2013-04-16 2014-10-16 Bayerische Motoren Werke Aktiengesellschaft Method for determining whether an occupant of a vehicle notices relevant objects in the vicinity of the vehicle
WO2015000693A1 (en) * 2013-07-03 2015-01-08 Bayerische Motoren Werke Aktiengesellschaft Showing of collision warnings on a head-mounted display
DE102013021854A1 (en) * 2013-12-21 2015-06-25 Audi Ag Visual and operating device for carrying out a method for determining a hazard potential in a vehicle
DE102013021854B4 (en) * 2013-12-21 2017-12-14 Audi Ag Visual and operating device for carrying out a method for determining a hazard potential in a vehicle

Similar Documents

Publication Publication Date Title
US7969383B2 (en) Interactive data view and command system
US7199366B2 (en) Method and device for visualizing a motor vehicle environment with environment-dependent fusion of an infrared image and a visual image
CN100423964C (en) Method and system for supporting path control
US8502860B2 (en) Electronic control system, electronic control unit and associated methodology of adapting 3D panoramic views of vehicle surroundings by predicting driver intent
US8686872B2 (en) Roadway condition warning on full windshield head-up display
DE102009004432B4 (en) A motor vehicle display device for displaying an image spot circling a front obstacle
US8754760B2 (en) Methods and apparatuses for informing an occupant of a vehicle of surroundings of the vehicle
JP2016506572A (en) Infotainment system
EP0475502A2 (en) Head-up display
US8692739B2 (en) Dynamic information presentation on full windshield head-up display
JP2005509129A (en) Enhanced display that informs the driver of the car about the surrounding visual information for navigation
KR20120067854A (en) Display system for augmented reality in vehicle, and method for the same
US5414439A (en) Head up display with night vision enhancement
US20090231116A1 (en) In-vehicle display device
DE10036570B4 (en) Display device
US8260536B2 (en) Road vehicle motoring aid method and system
US6208933B1 (en) Cartographic overlay on sensor video
US8212662B2 (en) Automotive display system and display method
KR101241865B1 (en) In-vehicle terminal for control forward looking infrared camera and method thereof
US20140036374A1 (en) Bifocal Head-up Display System
US20020011925A1 (en) Attention control for operators of technical equipment
US20110175798A1 (en) Display device for vehicle
ES2316011T3 (en) Projection screen.
US20040178894A1 (en) Head-up display system and method for carrying out the location-correct display of an object situated outside a vehicle with regard to the position of the driver
US9280202B2 (en) Vehicle vision system

Legal Events

Date Code Title Description
OM8 Search report available as to paragraph 43 lit. 1 sentence 1 patent law
8127 New person/name/address of the applicant

Owner name: CONTINENTAL AUTOMOTIVE GMBH, 30165 HANNOVER, DE

8139 Disposal/non-payment of the annual fee