EP3580728A1 - Device for assisting night-time road navigation - Google Patents
Device for assisting night-time road navigationInfo
- Publication number
- EP3580728A1 EP3580728A1 EP18705708.8A EP18705708A EP3580728A1 EP 3580728 A1 EP3580728 A1 EP 3580728A1 EP 18705708 A EP18705708 A EP 18705708A EP 3580728 A1 EP3580728 A1 EP 3580728A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- display
- night
- vision system
- zone
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 230000004297 night vision Effects 0.000 claims abstract description 33
- 230000004438 eyesight Effects 0.000 claims description 2
- 241001465754 Metazoa Species 0.000 description 5
- 238000001514 detection method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000004313 glare Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/30—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles providing vision in the non-visible spectrum, e.g. night or infrared vision
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Arrangement of adaptations of instruments
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
- B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
- B60R1/24—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view in front of the vehicle
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3626—Details of the output of route guidance instructions
- G01C21/3647—Guidance involving output of stored or live camera images or video streams
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- B60K2360/166—
-
- B60K2360/176—
-
- B60K35/28—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
- B60R2300/106—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using night vision cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
- B60R2300/307—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing virtually distinguishing relevant parts of a scene from the background of the scene
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/8053—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for bad weather conditions or night vision
Definitions
- the invention relates to a device for assisting navigation and more particularly the aid to night road navigation for a vehicle, in particular a motor vehicle.
- So-called "night vision” systems which use a camera more sensitive than the human eye to film a scene at the front of the vehicle, and which restore this image to the driver on a screen.
- the objective of these systems is to be able to drive at night, or in conditions of reduced visibility (rain, snow, fog, ...) with a visibility higher than that offered by the headlights, while avoiding glare.
- These systems provide the driver with information on the road scene that he does not perceive or perceive less well by looking at the road, but that he has the opportunity to see if he is looking at the screen, such as, for example, the presence of a pedestrian on the side of the road or a road profile in the distance.
- the French patent application FR2902381 discloses a night vision system that: detects the location of the area of the road scene seen by an image forming device, and the production of a corresponding synthetic image at said area of the localized road scene, and merging the image picked up by the image forming device and said synthesis image, the result of said merging being displayed on the vehicle screen.
- the invention therefore aims to provide a night vision device for not only distract a driver, and secondly to alert accurately and effectively when a danger is detected.
- a device for assisting the night driving of a vehicle comprising at least one display (23) and a night vision system (20) adapted to capture images in dark condition and to transmit them to said display (23), said display (23) being able to display a graphic page (31) comprising a first area (31. 1) and second zone (31 .2) arranged next to said first zone (31 .1), the display (23) comprising a first display mode in which said first zone (31. operation of said vehicle characterized in that the display (23) is adapted, in response to receiving an alert signal from a night vision system (20), to be displayed in the second zone (31). .2) images from the night vision system (20).
- the invention makes it possible to display punctually when an alert is emitted by the night vision system to display images from said system. Thus, when no alert is issued, these images do not disturb the driver. These images are displayed in a predetermined area (the second area) so that the vehicle operating information (displayed in the first area) remains visible. Maintaining the display of this information makes it possible not to disturb unnecessarily the driver who keeps a visual cue on these displays.
- the display of the images allows the driver to see very precisely the nature of the alert signaled by the night vision system.
- the night vision system being able to emit a first and a second level of alert, the first level of alert indicating a risk higher than the second level of alert
- said display is configured to display, in the first display mode, images from the night vision system in the second zone, only in response to the receipt of an alert signal corresponds to a first level of alert.
- Images from the night vision system are only displayed when a first level alert is issued.
- said display is configured to display, in the first display mode, the images coming from the night vision system, in an ad hoc manner, only the time that the reception of said alert signal lasts.
- the display comprises means for resizing and / or reframing the images coming from the night vision system, the displayed image, in the first display mode, in the second zone being cropped or resized.
- This feature makes it possible to display an image from the night vision system over a small area of the screen while maintaining a high level of information focused on the danger associated with the alert.
- the display comprises a second display mode in which the display permanently displays in said first zone images from the night vision system.
- the second display mode allows the driver to have images from the vision system when he wants.
- the display is able to switch from the first display mode to the second display mode, and vice versa, in response to the receipt of a command from a user.
- the display is able to display, in the first display mode, an indicator indicating whether the night vision system is active.
- the indicator makes it possible to signal to the driver whether the night vision system is activated because, in the absence of a permanently displayed image, the driver has no other way of knowing if the system is active when no alert is in progress.
- the first zone comprises vehicle operating data or guidance data.
- the first zone is displayed on a central part of the display.
- the graphic page further comprises a third zone, the second and third zones being located on either side of the first zone.
- the invention also relates to a vehicle characterized in that it comprises a night driving assistance device according to the invention.
- FIG. 1 illustrates a motor vehicle dashboard according to the invention
- FIG. 2 illustrates a block diagram of the system according to the invention
- FIG. 3a illustrates a first display mode according to the invention
- FIG. 3b illustrates the first display mode when an alert of the night vision system is emitted
- FIG. 4 illustrates a second display mode according to the invention.
- a motor vehicle dashboard equipped with two screens and a night navigation system is shown.
- a first screen 1 is a screen of a conventional road navigation system, GPS type (acronym for "Global Positioning System”), displaying, in a manner known per se, a map and plots, perspectives, colors and informations.
- a second screen 2 is a screen of a system called "night vision”. On screen 2, the result is similar to a very detailed video image in white and black, of the road scene referenced Z.
- the architecture of the night vision system according to the invention is illustrated by the block diagram of FIG.
- the system 20 comprises an image acquisition device 21, a computer 22 communicates with at least one display 23.
- the image acquisition device 21 is constituted by at least one night vision camera, installed on the front of the vehicle.
- the camera discreetly integrated into the front of the vehicle, receives infrared reflector images reflected by the road.
- a camera captures radiation thermal elements of the scene.
- LVDS connection (acronym for "Low Voltage Differential Signaling") makes it possible to connect two pieces of equipment and to carry, on the one hand, video data and, on the other hand, non-video data.
- the computer 22 comprises a module (electronic module) for image processing from the acquisition device 21.
- the processed images are transmitted to the display 23 via a second video link 25, for example of the LVDS type.
- the computer 22 comprises a pedestrian detection module.
- the detection module also transmits an alert signal on a CAN bus 26 of the vehicle and / or on the second video link 25, for example of the LVDS type, to the display 23, during a detection of a cyclist or animal.
- the calculator 22 is able to emit a first and a second alert level, the first alert level indicating a higher risk than the second alert level.
- the first level of alert corresponds for example to the detection of a pedestrian or an animal on the road.
- the second level of alert corresponds for example to the detection of a pedestrian or an animal on the roadside.
- pedestrians or animals, detected on the road or on the aisles can then be highlighted, for example by flashing in a color (eg red or yellow) and / or displaying a pictogram .
- a color eg red or yellow
- the display 23 may be the second screen 2 in the drawing of Figure 1, or another image projection system according to another embodiment.
- the display 23 may be a conventional LCD type screen (acronym for "Liquid Crystal Display” for LCD), for example, or a HUD type image projection system (acronym for "Head Up”). Display “for" head-up display "), for example.
- the display 23 comprises at least two different display modes. Each of the two display modes comprises a first display area 31 .1 situated in the central part of the screen. A second display area 31.2 and a third display area 31.3 are disposed on either side of the first display area 31 1 respectively on the right and on the left.
- the display 23 comprises for example at least one of the modes described below.
- Fig. 3a shows a first display mode 31 where the first display area 31 .1 includes vehicle operating data. In the example, it is an indication of the speed of the vehicle whose value is 90km / h.
- the second display area 31.2 includes a guidance instruction.
- the third display area 31.2 also includes an indication of the vehicle speed but in the form of a counter.
- the display area 31 .1 is intended for displaying information permanently.
- the second 31.2 and third 31.3 zones are able to display one-off information (for example navigation instructions or alerts).
- Figure 3b shows the first display mode 31 when the display 23 receives an alert from the night vision system.
- the first and third zones are identical to FIG. 3a.
- By against the second zone displays an image from the camera 21 and a pictogram.
- the second zone 31 .2 includes an indication of a level whose value is of the order of 3.5.
- the third zone 31 .3 includes an indication of the speed of the vehicle whose value is 90km / h.
- the image from the camera 21 has an indication (in the form of a colored polygon) that an animal is detected.
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1751019A FR3062742B1 (en) | 2017-02-07 | 2017-02-07 | AID DEVICE FOR NIGHT ROAD NAVIGATION |
PCT/FR2018/050261 WO2018146401A1 (en) | 2017-02-07 | 2018-02-02 | Device for assisting night-time road navigation |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3580728A1 true EP3580728A1 (en) | 2019-12-18 |
Family
ID=58501703
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18705708.8A Withdrawn EP3580728A1 (en) | 2017-02-07 | 2018-02-02 | Device for assisting night-time road navigation |
Country Status (5)
Country | Link |
---|---|
US (1) | US20190381936A1 (en) |
EP (1) | EP3580728A1 (en) |
CN (1) | CN110300992B (en) |
FR (1) | FR3062742B1 (en) |
WO (1) | WO2018146401A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP4050893A1 (en) * | 2021-02-24 | 2022-08-31 | Ningbo Geely Automobile Research & Development Co. Ltd. | A view support system at a vehicle for supporting a vehicle occupant to see the surroundings of the vehicle |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020067413A1 (en) * | 2000-12-04 | 2002-06-06 | Mcnamara Dennis Patrick | Vehicle night vision system |
DE102006011481A1 (en) * | 2006-03-13 | 2007-09-20 | Robert Bosch Gmbh | A method and apparatus for assisting in guiding a vehicle |
FR2902381B1 (en) * | 2006-06-20 | 2008-11-28 | Peugeot Citroen Automobiles Sa | MERGING IMAGES BETWEEN A NAVIGATION SYSTEM AND A NIGHT VISION SYSTEM |
JP5142042B2 (en) * | 2008-06-26 | 2013-02-13 | 日本精機株式会社 | Vehicle display device |
JP4952765B2 (en) * | 2009-10-21 | 2012-06-13 | トヨタ自動車株式会社 | Vehicle night vision support device |
JP5742937B2 (en) * | 2011-06-02 | 2015-07-01 | トヨタ自動車株式会社 | Visibility support device for vehicle |
KR20150090446A (en) * | 2014-01-29 | 2015-08-06 | 쌍용자동차 주식회사 | Apparatus for pedestrian sensing and indicating with night-vision and method thereof |
-
2017
- 2017-02-07 FR FR1751019A patent/FR3062742B1/en active Active
-
2018
- 2018-02-02 EP EP18705708.8A patent/EP3580728A1/en not_active Withdrawn
- 2018-02-02 CN CN201880010800.8A patent/CN110300992B/en active Active
- 2018-02-02 US US16/477,459 patent/US20190381936A1/en not_active Abandoned
- 2018-02-02 WO PCT/FR2018/050261 patent/WO2018146401A1/en unknown
Also Published As
Publication number | Publication date |
---|---|
CN110300992A (en) | 2019-10-01 |
CN110300992B (en) | 2023-09-26 |
FR3062742B1 (en) | 2020-05-08 |
US20190381936A1 (en) | 2019-12-19 |
WO2018146401A1 (en) | 2018-08-16 |
FR3062742A1 (en) | 2018-08-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11034299B2 (en) | Vehicular vision system with episodic display of video images showing approaching other vehicle | |
US11498494B2 (en) | Vehicular camera monitoring system | |
US10384610B2 (en) | Rearview vision system for vehicle | |
US8354944B2 (en) | Night vision device | |
JP4882285B2 (en) | Vehicle travel support device | |
US6327522B1 (en) | Display apparatus for vehicle | |
US9199536B2 (en) | On-vehicle display device and on-vehicle display program | |
US20060164219A1 (en) | Method and device for warning the driver of a motor vehicle | |
US20090187333A1 (en) | Method and System for Displaying Navigation Instructions | |
US20180015879A1 (en) | Side-view mirror camera system for vehicle | |
CN104163133A (en) | Rear view camera system using rear view mirror location | |
JP2008193339A (en) | Rear monitoring system | |
US11117520B2 (en) | Display control device, display control system, display control method, and program | |
US20200171951A1 (en) | Vehicular projection control device and head-up display device | |
FR3066158B1 (en) | METHOD AND SYSTEM FOR ALERTING A PRESENCE IN A DEAD ANGLE OF A VEHICLE | |
JP2017202721A (en) | Display system | |
WO2018146401A1 (en) | Device for assisting night-time road navigation | |
JP5686042B2 (en) | Vehicle periphery display device | |
WO2006087524A1 (en) | A driver assistance system | |
JP2019001293A (en) | On-vehicle display device | |
EP3867126B1 (en) | Method and device for assisting with driving a motor vehicle during reversing | |
JP2005324745A (en) | Display device for vehicle | |
TWI301812B (en) | Image recognition anti-collision system for a vehicle | |
JP2010058548A (en) | Night vision device for vehicle | |
CN117125091A (en) | Intelligent driving assistance method and device based on perception |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20190830 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20200625 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: PSA AUTOMOBILES SA |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20210910 |